You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@sd-datasolutions.de> on 2012/12/27 19:38:50 UTC

[JENKINS] Lucene-Solr-trunk-MacOSX (32bit/jdk1.7.0) - Build # 1 - Failure!

Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/1/
Java: 32bit/jdk1.7.0 -server -XX:+UseG1GC

No tests ran.

Build Log:
[...truncated 7460 lines...]
FATAL: command execution failed
java.io.IOException: Cannot run program "cmd" (in directory "/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX"): error=2, No such file or directory
	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
	at hudson.Proc$LocalProc.<init>(Proc.java:244)
	at hudson.Proc$LocalProc.<init>(Proc.java:216)
	at hudson.Launcher$LocalLauncher.launch(Launcher.java:763)
	at hudson.Launcher$ProcStarter.start(Launcher.java:353)
	at hudson.Launcher$RemoteLaunchCallable.call(Launcher.java:988)
	at hudson.Launcher$RemoteLaunchCallable.call(Launcher.java:955)
	at hudson.remoting.UserRequest.perform(UserRequest.java:118)
	at hudson.remoting.UserRequest.perform(UserRequest.java:48)
	at hudson.remoting.Request$2.run(Request.java:326)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
	at java.lang.Thread.run(Thread.java:722)
Caused by: java.io.IOException: error=2, No such file or directory
	at java.lang.UNIXProcess.forkAndExec(Native Method)
	at java.lang.UNIXProcess.<init>(UNIXProcess.java:135)
	at java.lang.ProcessImpl.start(ProcessImpl.java:130)
	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1021)
	... 15 more
Build step 'Execute Windows batch command' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0 -server -XX:+UseG1GC
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build # 10 - Still Failing!

Posted by Robert Muir <rc...@gmail.com>.
Thanks!

On Fri, Dec 28, 2012 at 11:01 AM, Uwe Schindler <uw...@thetaphi.de> wrote:
> Sorry, fixed!
>
> -----
> Uwe Schindler
> H.-H.-Meier-Allee 63, D-28213 Bremen
> http://www.thetaphi.de
> eMail: uwe@thetaphi.de
>
>
>> -----Original Message-----
>> From: Robert Muir [mailto:rcmuir@gmail.com]
>> Sent: Friday, December 28, 2012 4:40 PM
>> To: dev@lucene.apache.org
>> Subject: Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build #
>> 10 - Still Failing!
>>
>> the links from policeman jenkins are a little busted right now:
>>
>> if i click on http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-
>> MacOSX/10/
>> it redirects to http://jenkins.thetaphi.dejob/Lucene-Solr-trunk-MacOSX/10/
>> but this should be http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-
>> MacOSX/10/
>>
>> (note the missing / after .de)
>>
>> On Fri, Dec 28, 2012 at 6:24 AM, Policeman Jenkins Server <jenkins@sd-
>> datasolutions.de> wrote:
>> > http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/10/
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
>> commands, e-mail: dev-help@lucene.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


RE: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build # 10 - Still Failing!

Posted by Uwe Schindler <uw...@thetaphi.de>.
Sorry, fixed!

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: Robert Muir [mailto:rcmuir@gmail.com]
> Sent: Friday, December 28, 2012 4:40 PM
> To: dev@lucene.apache.org
> Subject: Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build #
> 10 - Still Failing!
> 
> the links from policeman jenkins are a little busted right now:
> 
> if i click on http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-
> MacOSX/10/
> it redirects to http://jenkins.thetaphi.dejob/Lucene-Solr-trunk-MacOSX/10/
> but this should be http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-
> MacOSX/10/
> 
> (note the missing / after .de)
> 
> On Fri, Dec 28, 2012 at 6:24 AM, Policeman Jenkins Server <jenkins@sd-
> datasolutions.de> wrote:
> > http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/10/
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org For additional
> commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build # 10 - Still Failing!

Posted by Robert Muir <rc...@gmail.com>.
the links from policeman jenkins are a little busted right now:

if i click on http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/10/
it redirects to http://jenkins.thetaphi.dejob/Lucene-Solr-trunk-MacOSX/10/
but this should be http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/10/

(note the missing / after .de)

On Fri, Dec 28, 2012 at 6:24 AM, Policeman Jenkins Server
<je...@sd-datasolutions.de> wrote:
> http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/10/

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


RE: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build # 10 - Still Failing!

Posted by Uwe Schindler <uw...@thetaphi.de>.
This error seems to happen frequently, but only on this Darwin-based operating system. Have not seen it before.

The new Darwin-based slave (with Steve's recent operating system numbered 10.8.2) has 2 CPU cores and one test runner (identical config like the windows machine). Both machines are virtual Hackintoshs. It looks like some Solr test failures always happen when the number of CPU cores is low or CPU power is limited (seen regularily on those virtual boxes).

I can now gladly announce the new Hackintosh slave on the Policeman Jenkins server - running running now 4.x and trunk jobs for Jobs!

Uwe

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de


> -----Original Message-----
> From: Policeman Jenkins Server [mailto:jenkins@sd-datasolutions.de]
> Sent: Friday, December 28, 2012 12:24 PM
> To: dev@lucene.apache.org
> Subject: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build # 10 -
> Still Failing!
> 
> Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-
> MacOSX/10/
> Java: 64bit/jdk1.6.0 -XX:+UseSerialGC
> 
> 1 tests failed.
> REGRESSION:
> org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration
> 
> Error Message:
> 
> 
> Stack Trace:
> java.lang.AssertionError
> 	at
> __randomizedtesting.SeedInfo.seed([D918F8FA64E198EA:67939E551D9B96D
> F]:0)
> 	at org.junit.Assert.fail(Assert.java:92)
> 	at org.junit.Assert.assertTrue(Assert.java:43)
> 	at org.junit.Assert.assertTrue(Assert.java:54)
> 	at
> org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterS
> tateUpdateTest.java:234)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:39)
> 	at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> 	at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.
> evaluate(SystemPropertiesRestoreRule.java:53)
> 	at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> 	at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> 	at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> 	at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> 	at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> 	at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> 	at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> 	at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> 	at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> 	at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> 	at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> 	at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> 	at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.
> evaluate(SystemPropertiesRestoreRule.java:53)
> 	at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> 	at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> 	at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> 	at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> 	at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> 	at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> 	at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> 	at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> 	at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> 	at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:680)
> 
> 
> 
> 
> Build Log:
> [...truncated 8663 lines...]
> [junit4:junit4] Suite: org.apache.solr.cloud.ClusterStateUpdateTest
> [junit4:junit4]   2> 5 T4707 oas.SolrTestCaseJ4.setUp ###Starting
> testCoreRegistration
> [junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871
> [junit4:junit4]   2> 6 T4707 oasc.ZkTestServer.run STARTING ZK TEST SERVER
> [junit4:junit4]   2> 7 T4708 oasc.ZkTestServer$ZKServerMain.runFromConfig
> Starting server
> [junit4:junit4]   2> 8 T4708 oazs.ZooKeeperServer.setTickTime tickTime set to
> 1000
> [junit4:junit4]   2> 9 T4708 oazs.ZooKeeperServer.setMinSessionTimeout
> minSessionTimeout set to -1
> [junit4:junit4]   2> 9 T4708 oazs.ZooKeeperServer.setMaxSessionTimeout
> maxSessionTimeout set to -1
> [junit4:junit4]   2> 9 T4708 oazs.NIOServerCnxnFactory.configure binding to
> port 0.0.0.0/0.0.0.0:0
> [junit4:junit4]   2> 18 T4708 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/zookeeper/server1/data/version-2/snapshot.0
> [junit4:junit4]   2> 112 T4707 oasc.ZkTestServer.run start zk server on
> port:57629
> [junit4:junit4]   2> 114 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629 sessionTimeout=10000
> watcher=org.apache.solr.common.cloud.ConnectionManager@6ed8c84
> [junit4:junit4]   2> 117 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 118 T4713 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> [junit4:junit4]   2> 121 T4713 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 122 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57630
> [junit4:junit4]   2> 124 T4709 oazs.ZooKeeperServer.processConnectRequest
> Client attempting to establish new session at /127.0.0.1:57630
> [junit4:junit4]   2> 126 T4711 oazsp.FileTxnLog.append Creating new log file:
> log.1
> [junit4:junit4]   2> 130 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d0000 with negotiated timeout 10000 for
> client /127.0.0.1:57630
> [junit4:junit4]   2> 131 T4713 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d0000, negotiated timeout = 10000
> [junit4:junit4]   2> 133 T4714 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@6ed8c84
> name:ZooKeeperConnection Watcher:127.0.0.1:57629 got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 134 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 135 T4707 oascc.SolrZkClient.makePath makePath: /solr
> [junit4:junit4]   2> 146 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d0000
> [junit4:junit4]   2> 150 T4714 oaz.ClientCnxn$EventThread.run EventThread
> shut down
> [junit4:junit4]   2> 148 T4707 oaz.ZooKeeper.close Session:
> 0x13be13bb93d0000 closed
> [junit4:junit4]   2> 153 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57630 which had sessionid
> 0x13be13bb93d0000
> [junit4:junit4]   2> 154 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629/solr sessionTimeout=10000
> watcher=org.apache.solr.common.cloud.ConnectionManager@2cd84941
> [junit4:junit4]   2> 156 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 158 T4715 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> [junit4:junit4]   2> 161 T4715 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 162 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57631
> [junit4:junit4]   2> 163 T4709 oazs.ZooKeeperServer.processConnectRequest
> Client attempting to establish new session at /127.0.0.1:57631
> [junit4:junit4]   2> 167 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d0001 with negotiated timeout 10000 for
> client /127.0.0.1:57631
> [junit4:junit4]   2> 167 T4715 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d0001, negotiated timeout = 10000
> [junit4:junit4]   2> 168 T4716 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@2cd84941
> name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 170 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 171 T4707 oascc.SolrZkClient.makePath makePath:
> /collections/collection1
> [junit4:junit4]   2> 182 T4707 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/shards
> [junit4:junit4]   2> 191 T4707 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection
> [junit4:junit4]   2> 201 T4707 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/shards
> [junit4:junit4]   2> 213 T4707 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml
> to /configs/conf1/solrconfig.xml
> [junit4:junit4]   2> 218 T4707 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/solrconfig.xml
> [junit4:junit4]   2> 239 T4707 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to
> /configs/conf1/schema.xml
> [junit4:junit4]   2> 244 T4707 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/schema.xml
> [junit4:junit4]   2> 257 T4707 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt
> to /configs/conf1/stopwords.txt
> [junit4:junit4]   2> 259 T4707 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/stopwords.txt
> [junit4:junit4]   2> 270 T4707 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt
> to /configs/conf1/protwords.txt
> [junit4:junit4]   2> 272 T4707 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/protwords.txt
> [junit4:junit4]   2> 284 T4707 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to
> /configs/conf1/currency.xml
> [junit4:junit4]   2> 286 T4707 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/currency.xml
> [junit4:junit4]   2> 298 T4707 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-
> exchange-rates.json to /configs/conf1/open-exchange-rates.json
> [junit4:junit4]   2> 300 T4707 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/open-exchange-rates.json
> [junit4:junit4]   2> 311 T4707 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-
> ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4]   2> 314 T4707 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/mapping-ISOLatin1Accent.txt
> [junit4:junit4]   2> 326 T4707 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-
> files/solr/collection1/conf/old_synonyms.txt to
> /configs/conf1/old_synonyms.txt
> [junit4:junit4]   2> 328 T4707 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/old_synonyms.txt
> [junit4:junit4]   2> 337 T4707 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt
> to /configs/conf1/synonyms.txt
> [junit4:junit4]   2> 338 T4707 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/synonyms.txt
> [junit4:junit4]   2> 343 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d0001
> [junit4:junit4]   2> 344 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57631 which had sessionid
> 0x13be13bb93d0001
> [junit4:junit4]   2> 345 T4716 oaz.ClientCnxn$EventThread.run EventThread
> shut down
> [junit4:junit4]   2> 344 T4707 oaz.ZooKeeper.close Session:
> 0x13be13bb93d0001 closed
> [junit4:junit4]   2> 345 T4707 oasc.ClusterStateUpdateTest.setUp
> ####SETUP_START testCoreRegistration
> [junit4:junit4]   2> 348 T4707 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 348 T4707 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home: /Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr
> [junit4:junit4]   2> 348 T4707 oasc.CoreContainer$Initializer.initialize looking
> for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/solr.xml
> [junit4:junit4]   2> 349 T4707 oasc.CoreContainer.<init> New CoreContainer
> 348292905
> [junit4:junit4]   2> 349 T4707 oasc.CoreContainer.load Loading CoreContainer
> using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test-files/solr/'
> [junit4:junit4]   2> 350 T4707 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory: '/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/'
> [junit4:junit4]   2> 380 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 30000
> [junit4:junit4]   2> 380 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: http://
> [junit4:junit4]   2> 381 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
> [junit4:junit4]   2> 381 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 381 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
> [junit4:junit4]   2> 382 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 382 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 383 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 383 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
> [junit4:junit4]   2> 383 T4707 oascsi.HttpClientUtil.createClient Creating new
> http client,
> config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout
> =30000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 397 T4707 oasc.CoreContainer.load Registering Log Listener
> [junit4:junit4]   2> 415 T4707 oasc.CoreContainer.initZooKeeper Zookeeper
> client=127.0.0.1:57629/solr
> [junit4:junit4]   2> 415 T4707 oasc.ZkController.checkChrootPath zkHost
> includes chroot
> [junit4:junit4]   2> 416 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629 sessionTimeout=60000
> watcher=org.apache.solr.common.cloud.ConnectionManager@2cc19747
> [junit4:junit4]   2> 417 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 418 T4717 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> [junit4:junit4]   2> 419 T4717 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 419 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57632
> [junit4:junit4]   2> 420 T4709 oazs.ZooKeeperServer.processConnectRequest
> Client attempting to establish new session at /127.0.0.1:57632
> [junit4:junit4]   2> 421 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d0002 with negotiated timeout 20000 for
> client /127.0.0.1:57632
> [junit4:junit4]   2> 421 T4717 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d0002, negotiated timeout = 20000
> [junit4:junit4]   2> 421 T4718 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@2cc19747
> name:ZooKeeperConnection Watcher:127.0.0.1:57629 got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 422 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 423 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d0002
> [junit4:junit4]   2> 424 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57632 which had sessionid
> 0x13be13bb93d0002
> [junit4:junit4]   2> 424 T4718 oaz.ClientCnxn$EventThread.run EventThread
> shut down
> [junit4:junit4]   2> 424 T4707 oaz.ZooKeeper.close Session:
> 0x13be13bb93d0002 closed
> [junit4:junit4]   2> 425 T4707 oascsi.HttpClientUtil.createClient Creating new
> http client,
> config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=
> 15000&connTimeout=30000
> [junit4:junit4]   2> 432 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629/solr sessionTimeout=3000
> watcher=org.apache.solr.common.cloud.ConnectionManager@14abeed
> [junit4:junit4]   2> 434 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 434 T4719 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> [junit4:junit4]   2> 435 T4719 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 435 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57633
> [junit4:junit4]   2> 436 T4709 oazs.ZooKeeperServer.processConnectRequest
> Client attempting to establish new session at /127.0.0.1:57633
> [junit4:junit4]   2> 437 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d0003 with negotiated timeout 3000 for
> client /127.0.0.1:57633
> [junit4:junit4]   2> 437 T4719 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d0003, negotiated timeout = 3000
> [junit4:junit4]   2> 437 T4720 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@14abeed
> name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 438 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 439 T4712 oazs.PrepRequestProcessor.pRequest Got user-
> level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 441 T4707 oascc.SolrZkClient.makePath makePath:
> /live_nodes
> [junit4:junit4]   2> 444 T4707 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1661_solr
> [junit4:junit4]   2> 445 T4712 oazs.PrepRequestProcessor.pRequest Got user-
> level KeeperException when processing sessionid:0x13be13bb93d0003
> type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error
> Path:/solr/live_nodes/127.0.0.1:1661_solr Error:KeeperErrorCode = NoNode
> for /solr/live_nodes/127.0.0.1:1661_solr
> [junit4:junit4]   2> 446 T4707 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:1661_solr
> [junit4:junit4]   2> 451 T4707 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/election
> [junit4:junit4]   2> 457 T4712 oazs.PrepRequestProcessor.pRequest Got user-
> level KeeperException when processing sessionid:0x13be13bb93d0003
> type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for
> /solr/overseer_elect/leader
> [junit4:junit4]   2> 458 T4707 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/leader
> [junit4:junit4]   2> 462 T4707 oasc.Overseer.start Overseer
> (id=88912264290959363-127.0.0.1:1661_solr-n_0000000000) starting
> [junit4:junit4]   2> 463 T4712 oazs.PrepRequestProcessor.pRequest Got user-
> level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 464 T4712 oazs.PrepRequestProcessor.pRequest Got user-
> level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 465 T4712 oazs.PrepRequestProcessor.pRequest Got user-
> level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 466 T4712 oazs.PrepRequestProcessor.pRequest Got user-
> level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 468 T4722 oasc.OverseerCollectionProcessor.run Process
> current queue of collection messages
> [junit4:junit4]   2> 469 T4707 oascc.SolrZkClient.makePath makePath:
> /clusterstate.json
> [junit4:junit4]   2> 472 T4707
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating
> cluster state from ZooKeeper...
> [junit4:junit4]   2> 476 T4721 oasc.Overseer$ClusterStateUpdater.run Starting
> to work on the main queue
> [junit4:junit4]   2> 484 T4723 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using instanceDir: /Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/collection1
> [junit4:junit4]   2> 484 T4723 oasc.ZkController.createCollectionZkNode Check
> for collection zkNode:collection1
> [junit4:junit4]   2> 491 T4723 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
> [junit4:junit4]   2> 491 T4723 oasc.ZkController.readConfigName Load
> collection config from:/collections/collection1
> [junit4:junit4]   2> 495 T4723 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory: '/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/collection1/'
> [junit4:junit4]   2> 497 T4723 oasc.SolrResourceLoader.replaceClassLoader
> Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to
> classloader
> [junit4:junit4]   2> 498 T4723 oasc.SolrResourceLoader.replaceClassLoader
> Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to
> classloader
> [junit4:junit4]   2> 615 T4723 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_50
> [junit4:junit4]   2> 686 T4723 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
> [junit4:junit4]   2> 687 T4723 oass.IndexSchema.readSchema Reading Solr
> Schema
> [junit4:junit4]   2> 695 T4723 oass.IndexSchema.readSchema Schema
> name=test
> [junit4:junit4]   2> 1299 T4723 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 1309 T4723 oass.IndexSchema.readSchema default search
> field in schema is text
> [junit4:junit4]   2> 1313 T4723 oass.IndexSchema.readSchema unique key
> field: id
> [junit4:junit4]   2> 1333 T4723 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 1337 T4723 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 1342 T4723 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 1344 T4723 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 1345 T4723 oasc.SolrCore.<init> [collection1] Opening new
> SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/,
> dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data1/
> [junit4:junit4]   2> 1346 T4723 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@c96ad7c
> [junit4:junit4]   2> 1346 T4723 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4]   2> 1347 T4723 oasc.CachingDirectoryFactory.get return new
> directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data1 forceNew:false
> [junit4:junit4]   2> 1347 T4723 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data1
> [junit4:junit4]   2> 1347 T4723 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null new=/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data1/index/
> [junit4:junit4]   2> 1347 T4723 oasc.SolrCore.initIndex WARNING [collection1]
> Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data1/index' doesn't exist. Creating
> new index...
> [junit4:junit4]   2> 1348 T4723 oasc.CachingDirectoryFactory.get return new
> directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data1/index forceNew:false
> [junit4:junit4]   2> 1349 T4723 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2>
> 	commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apa
> che.lucene.store.RAMDirectory@4ff2a4cf
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c522ff4)),segF
> N=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 1349 T4723 oasc.SolrDeletionPolicy.updateCommits
> newest commit = 1[segments_1]
> [junit4:junit4]   2> 1349 T4723 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data1/index
> [junit4:junit4]   2> 1350 T4723 oasc.SolrCore.initWriters created xml:
> solr.XMLResponseWriter
> [junit4:junit4]   2> 1351 T4723 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 1351 T4723 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 1351 T4723 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 1352 T4723 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 1352 T4723 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 1352 T4723 oasc.RequestHandlers.initHandlersFromConfig
> adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 1353 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 1353 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 1353 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 1354 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created dismax: solr.SearchHandler
> [junit4:junit4]   2> 1354 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 1355 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 1355 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 1355 T4723 oasc.RequestHandlers.initHandlersFromConfig
> adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 1356 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 1356 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 1356 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1357 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1357 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH_Direct:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1357 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckWithWordbreak:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1358 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckWithWordbreak_Direct:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1358 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH1:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1359 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1359 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 1360 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 1360 T4723 oasc.RequestHandlers.initHandlersFromConfig
> created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 1364 T4723 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 1368 T4723 oasc.SolrCore.initDeprecatedSupport
> WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please
> update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 1369 T4723 oasc.SolrCore.initDeprecatedSupport
> WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML,
> OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-
> EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-
> ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 1371 T4723 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data1
> [junit4:junit4]   2> 1372 T4723 oass.SolrIndexSearcher.<init> Opening
> Searcher@6fd42ccf main
> [junit4:junit4]   2> 1372 T4723 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
> [junit4:junit4]   2> 1373 T4723 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
> [junit4:junit4]   2> 1373 T4723 oashc.SpellCheckComponent.inform Initializing
> spell checkers
> [junit4:junit4]   2> 1378 T4723 oass.DirectSolrSpellChecker.init init:
> {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLe
> ngth=3}
> [junit4:junit4]   2> 1404 T4724 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@6fd42ccf
> main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 1409 T4723 oasc.ZkController.publish publishing
> core=collection1 state=down
> [junit4:junit4]   2> 1409 T4723 oasc.ZkController.publish numShards not found
> on descriptor - reading it from system property
> [junit4:junit4]   2> 1411 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x53 zxid:0x29 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for
> /solr/overseer/queue
> [junit4:junit4]   2> 1493 T4721 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 1494 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
> [junit4:junit4]   2> 1494 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to
> shard shard=shard1
> [junit4:junit4]   2> 1495 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x5b zxid:0x2c txntype:-1 reqpath:n/a Error
> Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for
> /solr/overseer/queue-work
> [junit4:junit4]   2> 1501 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 2417 T4723 oasc.CoreContainer.registerCore registering
> core: collection1
> [junit4:junit4]   2> 2417 T4723 oasc.ZkController.register Register replica -
> core:collection1 address:http://127.0.0.1:1661/solr collection:collection1
> shard:shard1
> [junit4:junit4]   2> 2419 T4723 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/leader_elect/shard1/election
> [junit4:junit4]   2> 2440 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0003
> type:delete cxid:0x78 zxid:0x36 txntype:-1 reqpath:n/a Error
> Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode
> for /solr/collections/collection1/leaders
> [junit4:junit4]   2> 2442 T4723
> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader
> process.
> [junit4:junit4]   2> 2443 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x79 zxid:0x37 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2449 T4723
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough
> replicas found to continue.
> [junit4:junit4]   2> 2450 T4723
> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader
> - try and sync
> [junit4:junit4]   2> 2450 T4723
> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
> http://127.0.0.1:1661/solr/collection1/
> [junit4:junit4]   2> 2451 T4723 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/leaders/shard1
> [junit4:junit4]   2> 2464 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x83 zxid:0x3b txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2521 T4721 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 2540 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 2578 T4723 oasc.ZkController.register We are
> http://127.0.0.1:1661/solr/collection1/ and leader is
> http://127.0.0.1:1661/solr/collection1/
> [junit4:junit4]   2> 2580 T4723 oasc.ZkController.checkRecovery WARNING
> Skipping recovery according to sys prop solrcloud.skip.autorecovery
> [junit4:junit4]   2> 2581 T4723 oasc.ZkController.publish publishing
> core=collection1 state=active
> [junit4:junit4]   2> 2582 T4723 oasc.ZkController.publish numShards not found
> on descriptor - reading it from system property
> [junit4:junit4]   2> 2591 T4723 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 2597 T4707 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 2598 T4707 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home: /Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr
> [junit4:junit4]   2> 2599 T4707 oasc.CoreContainer$Initializer.initialize looking
> for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/solr.xml
> [junit4:junit4]   2> 2600 T4707 oasc.CoreContainer.<init> New CoreContainer
> 287074249
> [junit4:junit4]   2> 2602 T4707 oasc.CoreContainer.load Loading
> CoreContainer using Solr Home: '/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/'
> [junit4:junit4]   2> 2603 T4707 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory: '/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/'
> [junit4:junit4]   2> 2639 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 30000
> [junit4:junit4]   2> 2639 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: http://
> [junit4:junit4]   2> 2640 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
> [junit4:junit4]   2> 2640 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 2640 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
> [junit4:junit4]   2> 2641 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 2641 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 2642 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 2642 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
> [junit4:junit4]   2> 2642 T4707 oascsi.HttpClientUtil.createClient Creating new
> http client,
> config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout
> =30000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 2658 T4707 oasc.CoreContainer.load Registering Log
> Listener
> [junit4:junit4]   2> 2677 T4707 oasc.CoreContainer.initZooKeeper Zookeeper
> client=127.0.0.1:57629/solr
> [junit4:junit4]   2> 2677 T4707 oasc.ZkController.checkChrootPath zkHost
> includes chroot
> [junit4:junit4]   2> 2678 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629 sessionTimeout=60000
> watcher=org.apache.solr.common.cloud.ConnectionManager@5f876e90
> [junit4:junit4]   2> 2679 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 2680 T4725 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> 
> [junit4:junit4]   2> 2681 T4725 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 2683 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57634
> [junit4:junit4]   2> 2683 T4709
> oazs.ZooKeeperServer.processConnectRequest Client attempting to
> establish new session at /127.0.0.1:57634
> [junit4:junit4]   2> 2685 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d0004 with negotiated timeout 20000 for
> client /127.0.0.1:57634
> [junit4:junit4]   2> 2685 T4725 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d0004, negotiated timeout = 20000
> [junit4:junit4]   2> 2686 T4726 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@5f876e90
> name:ZooKeeperConnection Watcher:127.0.0.1:57629 got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 2686 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 2687 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d0004
> [junit4:junit4]   2> 2688 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57634 which had sessionid
> 0x13be13bb93d0004
> [junit4:junit4]   2> 2689 T4707 oaz.ZooKeeper.close Session:
> 0x13be13bb93d0004 closed
> [junit4:junit4]   2> 2691 T4707 oascsi.HttpClientUtil.createClient Creating new
> http client,
> config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=
> 15000&connTimeout=30000
> [junit4:junit4]   2> 2695 T4726 oaz.ClientCnxn$EventThread.run EventThread
> shut down
> [junit4:junit4]   2> 2721 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629/solr sessionTimeout=3000
> watcher=org.apache.solr.common.cloud.ConnectionManager@12ecb0ea
> [junit4:junit4]   2> 2750 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 2751 T4727 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> 
> [junit4:junit4]   2> 2753 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57635
> [junit4:junit4]   2> 2753 T4727 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 2754 T4709
> oazs.ZooKeeperServer.processConnectRequest Client attempting to
> establish new session at /127.0.0.1:57635
> [junit4:junit4]   2> 2755 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d0005 with negotiated timeout 3000 for
> client /127.0.0.1:57635
> [junit4:junit4]   2> 2756 T4727 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d0005, negotiated timeout = 3000
> [junit4:junit4]   2> 2756 T4728 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@12ecb0ea
> name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 2757 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 2758 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0005
> type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2759 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0005
> type:create cxid:0x2 zxid:0x49 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 2761 T4707 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1662_solr
> [junit4:junit4]   2> 2762 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0005
> type:delete cxid:0x4 zxid:0x4a txntype:-1 reqpath:n/a Error
> Path:/solr/live_nodes/127.0.0.1:1662_solr Error:KeeperErrorCode = NoNode
> for /solr/live_nodes/127.0.0.1:1662_solr
> [junit4:junit4]   2> 2763 T4707 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:1662_solr
> [junit4:junit4]   2> 2766 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeChildrenChanged
> path:/live_nodes, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 2768 T4720 oascc.ZkStateReader$3.process Updating live
> nodes... (2)
> [junit4:junit4]   2> 2777 T4707
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating
> cluster state from ZooKeeper...
> [junit4:junit4]   2> 2789 T4729 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using instanceDir: /Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/collection1
> [junit4:junit4]   2> 2790 T4729 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:collection1
> [junit4:junit4]   2> 2790 T4729 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
> [junit4:junit4]   2> 2791 T4729 oasc.ZkController.readConfigName Load
> collection config from:/collections/collection1
> [junit4:junit4]   2> 2793 T4729 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory: '/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/collection1/'
> [junit4:junit4]   2> 2794 T4729 oasc.SolrResourceLoader.replaceClassLoader
> Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to
> classloader
> [junit4:junit4]   2> 2794 T4729 oasc.SolrResourceLoader.replaceClassLoader
> Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to
> classloader
> [junit4:junit4]   2> 2845 T4729 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_50
> [junit4:junit4]   2> 2935 T4729 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
> [junit4:junit4]   2> 2937 T4729 oass.IndexSchema.readSchema Reading Solr
> Schema
> [junit4:junit4]   2> 2943 T4729 oass.IndexSchema.readSchema Schema
> name=test
> [junit4:junit4]   2> 3050 T4721 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 3050 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
> [junit4:junit4]   2> 3055 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 3056 T4728 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 3545 T4729 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 3553 T4729 oass.IndexSchema.readSchema default search
> field in schema is text
> [junit4:junit4]   2> 3557 T4729 oass.IndexSchema.readSchema unique key
> field: id
> [junit4:junit4]   2> 3579 T4729 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 3585 T4729 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 3590 T4729 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 3592 T4729 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 3594 T4729 oasc.SolrCore.<init> [collection1] Opening new
> SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/,
> dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data2/
> [junit4:junit4]   2> 3595 T4729 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@c96ad7c
> [junit4:junit4]   2> 3596 T4729 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4]   2> 3597 T4729 oasc.CachingDirectoryFactory.get return new
> directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data2 forceNew:false
> [junit4:junit4]   2> 3597 T4729 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data2
> [junit4:junit4]   2> 3597 T4729 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null new=/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data2/index/
> [junit4:junit4]   2> 3598 T4729 oasc.SolrCore.initIndex WARNING [collection1]
> Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data2/index' doesn't exist. Creating
> new index...
> [junit4:junit4]   2> 3599 T4729 oasc.CachingDirectoryFactory.get return new
> directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data2/index forceNew:false
> [junit4:junit4]   2> 3600 T4729 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2>
> 	commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apa
> che.lucene.store.RAMDirectory@1c23ef3c
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@61e3666c)),segF
> N=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 3600 T4729 oasc.SolrDeletionPolicy.updateCommits
> newest commit = 1[segments_1]
> [junit4:junit4]   2> 3601 T4729 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data2/index
> [junit4:junit4]   2> 3601 T4729 oasc.SolrCore.initWriters created xml:
> solr.XMLResponseWriter
> [junit4:junit4]   2> 3603 T4729 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 3604 T4729 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 3604 T4729 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 3605 T4729 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 3605 T4729 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 3605 T4729 oasc.RequestHandlers.initHandlersFromConfig
> adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 3606 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 3618 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 3619 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 3619 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created dismax: solr.SearchHandler
> [junit4:junit4]   2> 3619 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 3620 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 3620 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 3620 T4729 oasc.RequestHandlers.initHandlersFromConfig
> adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 3620 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 3621 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 3621 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3621 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3622 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH_Direct:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3622 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckWithWordbreak:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3622 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckWithWordbreak_Direct:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3623 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH1:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3623 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3623 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 3624 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 3624 T4729 oasc.RequestHandlers.initHandlersFromConfig
> created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 3627 T4729 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 3630 T4729 oasc.SolrCore.initDeprecatedSupport
> WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please
> update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 3631 T4729 oasc.SolrCore.initDeprecatedSupport
> WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML,
> OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-
> EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-
> ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 3633 T4729 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data2
> [junit4:junit4]   2> 3633 T4729 oass.SolrIndexSearcher.<init> Opening
> Searcher@54227e95 main
> [junit4:junit4]   2> 3634 T4729 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
> [junit4:junit4]   2> 3634 T4729 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
> [junit4:junit4]   2> 3634 T4729 oashc.SpellCheckComponent.inform Initializing
> spell checkers
> [junit4:junit4]   2> 3638 T4729 oass.DirectSolrSpellChecker.init init:
> {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLe
> ngth=3}
> [junit4:junit4]   2> 3674 T4730 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@54227e95
> main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 3681 T4729 oasc.ZkController.publish publishing
> core=collection1 state=down
> [junit4:junit4]   2> 3681 T4729 oasc.ZkController.publish numShards not found
> on descriptor - reading it from system property
> [junit4:junit4]   2> 4073 T4721 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 4075 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:1662_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1662/solr"}
> [junit4:junit4]   2> 4076 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Collection already exists
> with numShards=1
> [junit4:junit4]   2> 4076 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to
> shard shard=shard1
> [junit4:junit4]   2> 4088 T4728 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 4089 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 4691 T4729 oasc.CoreContainer.registerCore registering
> core: collection1
> [junit4:junit4]   2> 4691 T4729 oasc.ZkController.register Register replica -
> core:collection1 address:http://127.0.0.1:1662/solr collection:collection1
> shard:shard1
> [junit4:junit4]   2> 4697 T4729 oasc.ZkController.register We are
> http://127.0.0.1:1662/solr/collection1/ and leader is
> http://127.0.0.1:1661/solr/collection1/
> [junit4:junit4]   2> 4697 T4729 oasc.ZkController.checkRecovery WARNING
> Skipping recovery according to sys prop solrcloud.skip.autorecovery
> [junit4:junit4]   2> 4698 T4729 oasc.ZkController.publish publishing
> core=collection1 state=active
> [junit4:junit4]   2> 4698 T4729 oasc.ZkController.publish numShards not found
> on descriptor - reading it from system property
> [junit4:junit4]   2> 4700 T4729 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 4702 T4707 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 4702 T4707 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home: /Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr
> [junit4:junit4]   2> 4702 T4707 oasc.CoreContainer$Initializer.initialize looking
> for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/solr.xml
> [junit4:junit4]   2> 4703 T4707 oasc.CoreContainer.<init> New CoreContainer
> 1535165846
> [junit4:junit4]   2> 4703 T4707 oasc.CoreContainer.load Loading
> CoreContainer using Solr Home: '/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/'
> [junit4:junit4]   2> 4704 T4707 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory: '/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/'
> [junit4:junit4]   2> 4733 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 30000
> [junit4:junit4]   2> 4733 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: http://
> [junit4:junit4]   2> 4734 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
> [junit4:junit4]   2> 4734 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 4734 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
> [junit4:junit4]   2> 4735 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 4735 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 4736 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 4736 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
> [junit4:junit4]   2> 4737 T4707 oascsi.HttpClientUtil.createClient Creating new
> http client,
> config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout
> =30000&connTimeout=15000&retry=false
> [junit4:junit4]   2> 4751 T4707 oasc.CoreContainer.load Registering Log
> Listener
> [junit4:junit4]   2> 4768 T4707 oasc.CoreContainer.initZooKeeper Zookeeper
> client=127.0.0.1:57629/solr
> [junit4:junit4]   2> 4769 T4707 oasc.ZkController.checkChrootPath zkHost
> includes chroot
> [junit4:junit4]   2> 4769 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629 sessionTimeout=60000
> watcher=org.apache.solr.common.cloud.ConnectionManager@686b3c55
> [junit4:junit4]   2> 4770 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 4771 T4731 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> 
> [junit4:junit4]   2> 4772 T4731 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 4772 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57636
> [junit4:junit4]   2> 4773 T4709
> oazs.ZooKeeperServer.processConnectRequest Client attempting to
> establish new session at /127.0.0.1:57636
> [junit4:junit4]   2> 4774 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d0006 with negotiated timeout 20000 for
> client /127.0.0.1:57636
> [junit4:junit4]   2> 4774 T4731 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d0006, negotiated timeout = 20000
> [junit4:junit4]   2> 4775 T4732 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@686b3c55
> name:ZooKeeperConnection Watcher:127.0.0.1:57629 got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 4775 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 4777 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d0006
> [junit4:junit4]   2> 4778 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57636 which had sessionid
> 0x13be13bb93d0006
> [junit4:junit4]   2> 4778 T4707 oaz.ZooKeeper.close Session:
> 0x13be13bb93d0006 closed
> [junit4:junit4]   2> 4778 T4732 oaz.ClientCnxn$EventThread.run EventThread
> shut down
> [junit4:junit4]   2> 4778 T4707 oascsi.HttpClientUtil.createClient Creating new
> http client,
> config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=
> 15000&connTimeout=30000
> [junit4:junit4]   2> 4785 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629/solr sessionTimeout=3000
> watcher=org.apache.solr.common.cloud.ConnectionManager@2c70bde0
> [junit4:junit4]   2> 4786 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 4786 T4733 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> 
> [junit4:junit4]   2> 4787 T4733 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 4787 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57637
> [junit4:junit4]   2> 4788 T4709
> oazs.ZooKeeperServer.processConnectRequest Client attempting to
> establish new session at /127.0.0.1:57637
> [junit4:junit4]   2> 4789 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d0007 with negotiated timeout 3000 for
> client /127.0.0.1:57637
> [junit4:junit4]   2> 4789 T4733 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d0007, negotiated timeout = 3000
> [junit4:junit4]   2> 4790 T4734 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@2c70bde0
> name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 4790 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 4791 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0007
> type:create cxid:0x1 zxid:0x5b txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 4792 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0007
> type:create cxid:0x2 zxid:0x5c txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 4794 T4707 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1663_solr
> [junit4:junit4]   2> 4794 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0007
> type:delete cxid:0x4 zxid:0x5d txntype:-1 reqpath:n/a Error
> Path:/solr/live_nodes/127.0.0.1:1663_solr Error:KeeperErrorCode = NoNode
> for /solr/live_nodes/127.0.0.1:1663_solr
> [junit4:junit4]   2> 4795 T4707 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:1663_solr
> [junit4:junit4]   2> 4798 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeChildrenChanged
> path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 4798 T4728 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeChildrenChanged
> path:/live_nodes, has occurred - updating... (live nodes size: 2)
> [junit4:junit4]   2> 4801 T4728 oascc.ZkStateReader$3.process Updating live
> nodes... (3)
> [junit4:junit4]   2> 4802 T4720 oascc.ZkStateReader$3.process Updating live
> nodes... (3)
> [junit4:junit4]   2> 4805 T4707
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating
> cluster state from ZooKeeper...
> [junit4:junit4]   2> 4813 T4735 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using instanceDir: /Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/collection1
> [junit4:junit4]   2> 4813 T4735 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:collection1
> [junit4:junit4]   2> 4814 T4735 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
> [junit4:junit4]   2> 4815 T4735 oasc.ZkController.readConfigName Load
> collection config from:/collections/collection1
> [junit4:junit4]   2> 4816 T4735 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory: '/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/collection1/'
> [junit4:junit4]   2> 4817 T4735 oasc.SolrResourceLoader.replaceClassLoader
> Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to
> classloader
> [junit4:junit4]   2> 4817 T4735 oasc.SolrResourceLoader.replaceClassLoader
> Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to
> classloader
> [junit4:junit4]   2> 4862 T4735 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_50
> [junit4:junit4]   2> 4936 T4735 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
> [junit4:junit4]   2> 4937 T4735 oass.IndexSchema.readSchema Reading Solr
> Schema
> [junit4:junit4]   2> 4943 T4735 oass.IndexSchema.readSchema Schema
> name=test
> [junit4:junit4]   2> 5104 T4721 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 5105 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:1662_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1662/solr"}
> [junit4:junit4]   2> 5110 T4734 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 5111 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 5111 T4728 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 5511 T4735 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 5520 T4735 oass.IndexSchema.readSchema default search
> field in schema is text
> [junit4:junit4]   2> 5524 T4735 oass.IndexSchema.readSchema unique key
> field: id
> [junit4:junit4]   2> 5548 T4735 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 5555 T4735 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 5562 T4735 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 5564 T4735 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 5567 T4735 oasc.SolrCore.<init> [collection1] Opening new
> SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/collection1/,
> dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3/
> [junit4:junit4]   2> 5567 T4735 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@c96ad7c
> [junit4:junit4]   2> 5568 T4735 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4]   2> 5568 T4735 oasc.CachingDirectoryFactory.get return new
> directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3 forceNew:false
> [junit4:junit4]   2> 5569 T4735 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3
> [junit4:junit4]   2> 5569 T4735 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null new=/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3/index/
> [junit4:junit4]   2> 5569 T4735 oasc.SolrCore.initIndex WARNING [collection1]
> Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data3/index' doesn't exist. Creating
> new index...
> [junit4:junit4]   2> 5570 T4735 oasc.CachingDirectoryFactory.get return new
> directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3/index forceNew:false
> [junit4:junit4]   2> 5571 T4735 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2>
> 	commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apa
> che.lucene.store.RAMDirectory@2ba5ab4e
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@38b7b2eb)),seg
> FN=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 5572 T4735 oasc.SolrDeletionPolicy.updateCommits
> newest commit = 1[segments_1]
> [junit4:junit4]   2> 5572 T4735 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3/index
> [junit4:junit4]   2> 5572 T4735 oasc.SolrCore.initWriters created xml:
> solr.XMLResponseWriter
> [junit4:junit4]   2> 5574 T4735 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 5574 T4735 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 5575 T4735 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 5575 T4735 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 5575 T4735 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 5575 T4735 oasc.RequestHandlers.initHandlersFromConfig
> adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 5575 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 5576 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 5577 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 5577 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created dismax: solr.SearchHandler
> [junit4:junit4]   2> 5577 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 5577 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 5578 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 5578 T4735 oasc.RequestHandlers.initHandlersFromConfig
> adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 5578 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 5579 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 5579 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 5579 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 5580 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH_Direct:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 5581 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckWithWordbreak:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 5581 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckWithWordbreak_Direct:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 5582 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH1:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 5582 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 5583 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 5583 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 5584 T4735 oasc.RequestHandlers.initHandlersFromConfig
> created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 5587 T4735 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 5591 T4735 oasc.SolrCore.initDeprecatedSupport
> WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please
> update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 5592 T4735 oasc.SolrCore.initDeprecatedSupport
> WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML,
> OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-
> EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-
> ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 5594 T4735 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3
> [junit4:junit4]   2> 5595 T4735 oass.SolrIndexSearcher.<init> Opening
> Searcher@40c516f5 main
> [junit4:junit4]   2> 5595 T4735 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
> [junit4:junit4]   2> 5595 T4735 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
> [junit4:junit4]   2> 5596 T4735 oashc.SpellCheckComponent.inform Initializing
> spell checkers
> [junit4:junit4]   2> 5600 T4735 oass.DirectSolrSpellChecker.init init:
> {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLe
> ngth=3}
> [junit4:junit4]   2> 5632 T4736 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@40c516f5
> main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 5635 T4735 oasc.ZkController.publish publishing
> core=collection1 state=down
> [junit4:junit4]   2> 5636 T4735 oasc.ZkController.publish numShards not found
> on descriptor - reading it from system property
> [junit4:junit4]   2> 6123 T4721 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 6126 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
> [junit4:junit4]   2> 6126 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Collection already exists
> with numShards=1
> [junit4:junit4]   2> 6127 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to
> shard shard=shard1
> [junit4:junit4]   2> 6144 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 6145 T4734 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 6145 T4728 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 6641 T4735 oasc.CoreContainer.registerCore registering
> core: collection1
> [junit4:junit4]   2> 6641 T4735 oasc.ZkController.register Register replica -
> core:collection1 address:http://127.0.0.1:1663/solr collection:collection1
> shard:shard1
> [junit4:junit4]   2> 6646 T4735 oasc.ZkController.register We are
> http://127.0.0.1:1663/solr/collection1/ and leader is
> http://127.0.0.1:1661/solr/collection1/
> [junit4:junit4]   2> 6646 T4735 oasc.ZkController.checkRecovery WARNING
> Skipping recovery according to sys prop solrcloud.skip.autorecovery
> [junit4:junit4]   2> 6646 T4735 oasc.ZkController.publish publishing
> core=collection1 state=active
> [junit4:junit4]   2> 6646 T4735 oasc.ZkController.publish numShards not found
> on descriptor - reading it from system property
> [junit4:junit4]   2> 6648 T4735 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 6649 T4707 oasc.ClusterStateUpdateTest.setUp
> ####SETUP_END testCoreRegistration
> [junit4:junit4]   2> 6650 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629/solr sessionTimeout=10000
> watcher=org.apache.solr.common.cloud.ConnectionManager@2617b1c1
> [junit4:junit4]   2> 6651 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 6651 T4737 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> 
> [junit4:junit4]   2> 6652 T4737 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 6653 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57638
> [junit4:junit4]   2> 6653 T4709
> oazs.ZooKeeperServer.processConnectRequest Client attempting to
> establish new session at /127.0.0.1:57638
> [junit4:junit4]   2> 6654 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d0008 with negotiated timeout 10000 for
> client /127.0.0.1:57638
> [junit4:junit4]   2> 6654 T4737 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d0008, negotiated timeout = 10000
> [junit4:junit4]   2> 6655 T4738 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@2617b1c1
> name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 6655 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 6656 T4707 oascc.SolrZkClient.makePath makePath:
> /collections/testcore
> [junit4:junit4]   2> 6662 T4721 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 6663 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
> [junit4:junit4]   2> 6664 T4707 oascc.SolrZkClient.makePath makePath:
> /collections/testcore/shards
> [junit4:junit4]   2> 6670 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 6671 T4728 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 6670 T4734 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 6671 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d0008
> [junit4:junit4]   2> 6673 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57638 which had sessionid
> 0x13be13bb93d0008
> [junit4:junit4]   2> 6673 T4707 oaz.ZooKeeper.close Session:
> 0x13be13bb93d0008 closed
> [junit4:junit4]   2> 6674 T4707 oasc.CoreContainer.create Creating SolrCore
> 'testcore' using instanceDir: /Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/testcore
> [junit4:junit4]   2> 6675 T4738 oaz.ClientCnxn$EventThread.run EventThread
> shut down
> [junit4:junit4]   2> 6675 T4707 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:testcore
> [junit4:junit4]   2> 6677 T4707 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
> [junit4:junit4]   2> 6677 T4707 oasc.ZkController.readConfigName Load
> collection config from:/collections/testcore
> [junit4:junit4]   2> 6680 T4707 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory: '/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-
> files/solr/testcore/'
> [junit4:junit4]   2> 6744 T4707 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_50
> [junit4:junit4]   2> 6807 T4707 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
> [junit4:junit4]   2> 6809 T4707 oass.IndexSchema.readSchema Reading Solr
> Schema
> [junit4:junit4]   2> 6815 T4707 oass.IndexSchema.readSchema Schema
> name=test
> [junit4:junit4]   2> 7459 T4707 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 7467 T4707 oass.IndexSchema.readSchema default search
> field in schema is text
> [junit4:junit4]   2> 7470 T4707 oass.IndexSchema.readSchema unique key
> field: id
> [junit4:junit4]   2> 7492 T4707 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 7497 T4707 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 7502 T4707 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 7504 T4707 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 7506 T4707 oasc.SolrCore.<init> [testcore] Opening new
> SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test-files/solr/testcore/,
> dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data4/
> [junit4:junit4]   2> 7506 T4707 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@c96ad7c
> [junit4:junit4]   2> 7507 T4707 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4]   2> 7507 T4707 oasc.CachingDirectoryFactory.get return new
> directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data4 forceNew:false
> [junit4:junit4]   2> 7508 T4707 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data4
> [junit4:junit4]   2> 7508 T4707 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null new=/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data4/index/
> [junit4:junit4]   2> 7508 T4707 oasc.SolrCore.initIndex WARNING [testcore]
> Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data4/index' doesn't exist. Creating
> new index...
> [junit4:junit4]   2> 7509 T4707 oasc.CachingDirectoryFactory.get return new
> directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data4/index forceNew:false
> [junit4:junit4]   2> 7510 T4707 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2>
> 	commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apa
> che.lucene.store.RAMDirectory@5fbe0d4
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@65102f8b)),segF
> N=segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 7511 T4707 oasc.SolrDeletionPolicy.updateCommits
> newest commit = 1[segments_1]
> [junit4:junit4]   2> 7511 T4707 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data4/index
> [junit4:junit4]   2> 7512 T4707 oasc.SolrCore.initWriters created xml:
> solr.XMLResponseWriter
> [junit4:junit4]   2> 7513 T4707 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 7514 T4707 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 7514 T4707 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 7514 T4707 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 7514 T4707 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 7515 T4707 oasc.RequestHandlers.initHandlersFromConfig
> adding lazy requestHandler: solr.ReplicationHandler
> [junit4:junit4]   2> 7515 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: solr.ReplicationHandler
> [junit4:junit4]   2> 7515 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
> [junit4:junit4]   2> 7517 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created /get: solr.RealTimeGetHandler
> [junit4:junit4]   2> 7517 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created dismax: solr.SearchHandler
> [junit4:junit4]   2> 7517 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 7518 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/: org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 7518 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created defaults: solr.StandardRequestHandler
> [junit4:junit4]   2> 7518 T4707 oasc.RequestHandlers.initHandlersFromConfig
> adding lazy requestHandler: solr.StandardRequestHandler
> [junit4:junit4]   2> 7519 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created lazy: solr.StandardRequestHandler
> [junit4:junit4]   2> 7519 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created /update: solr.UpdateRequestHandler
> [junit4:junit4]   2> 7519 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created /terms: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 7520 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 7521 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH_Direct:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 7522 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckWithWordbreak:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 7522 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckWithWordbreak_Direct:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 7523 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created spellCheckCompRH1:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 7523 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created mltrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 7524 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created tvrh: org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 7525 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created /mlt: solr.MoreLikeThisHandler
> [junit4:junit4]   2> 7525 T4707 oasc.RequestHandlers.initHandlersFromConfig
> created /debug/dump: solr.DumpRequestHandler
> [junit4:junit4]   2> 7531 T4707 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 7535 T4707 oasc.SolrCore.initDeprecatedSupport
> WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please
> update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 7536 T4707 oasc.SolrCore.initDeprecatedSupport
> WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML,
> OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-
> EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-
> ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 7539 T4707 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data4
> [junit4:junit4]   2> 7540 T4707 oass.SolrIndexSearcher.<init> Opening
> Searcher@72b6e11e main
> [junit4:junit4]   2> 7541 T4707 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
> [junit4:junit4]   2> 7541 T4707 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
> [junit4:junit4]   2> 7542 T4707 oashc.SpellCheckComponent.inform Initializing
> spell checkers
> [junit4:junit4]   2> 7548 T4707 oass.DirectSolrSpellChecker.init init:
> {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLe
> ngth=3}
> [junit4:junit4]   2> 7575 T4739 oasc.SolrCore.registerSearcher [testcore]
> Registered new searcher Searcher@72b6e11e
> main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 7581 T4707 oasc.ZkController.publish publishing
> core=testcore state=down
> [junit4:junit4]   2> 7582 T4707 oasc.ZkController.publish numShards not found
> on descriptor - reading it from system property
> [junit4:junit4]   2> 7706 T4721 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 7708 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"testcore",
> [junit4:junit4]   2> 	  "collection":"testcore",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
> [junit4:junit4]   2> 7709 T4721
> oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to
> shard shard=shard1
> [junit4:junit4]   2> 7724 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 7724 T4728 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 7724 T4734 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 8592 T4707 oasc.CoreContainer.registerCore registering
> core: testcore
> [junit4:junit4]   2> 8593 T4707 oasc.ZkController.register Register replica -
> core:testcore address:http://127.0.0.1:1661/solr collection:testcore
> shard:shard1
> [junit4:junit4]   2> 8597 T4707 oascc.SolrZkClient.makePath makePath:
> /collections/testcore/leader_elect/shard1/election
> [junit4:junit4]   2> 8626 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0003
> type:delete cxid:0x14d zxid:0x7c txntype:-1 reqpath:n/a Error
> Path:/solr/collections/testcore/leaders Error:KeeperErrorCode = NoNode for
> /solr/collections/testcore/leaders
> [junit4:junit4]   2> 8628 T4707
> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader
> process.
> [junit4:junit4]   2> 8632 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x14e zxid:0x7d txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 8640 T4707
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough
> replicas found to continue.
> [junit4:junit4]   2> 8641 T4707
> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader
> - try and sync
> [junit4:junit4]   2> 8641 T4707
> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
> http://127.0.0.1:1661/solr/testcore/
> [junit4:junit4]   2> 8642 T4707 oascc.SolrZkClient.makePath makePath:
> /collections/testcore/leaders/shard1
> [junit4:junit4]   2> 8658 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d0003
> type:create cxid:0x158 zxid:0x81 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 8747 T4721 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 8776 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 8777 T4734 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 8778 T4728 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 8822 T4707 oasc.ZkController.register We are
> http://127.0.0.1:1661/solr/testcore/ and leader is
> http://127.0.0.1:1661/solr/testcore/
> [junit4:junit4]   2> 8823 T4707 oasc.ZkController.checkRecovery WARNING
> Skipping recovery according to sys prop solrcloud.skip.autorecovery
> [junit4:junit4]   2> 8824 T4707 oasc.ZkController.publish publishing
> core=testcore state=active
> [junit4:junit4]   2> 8825 T4707 oasc.ZkController.publish numShards not found
> on descriptor - reading it from system property
> [junit4:junit4]   2> 8831 T4707 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 8834 T4707 oasc.CoreContainer.shutdown Shutting down
> CoreContainer instance=1535165846
> [junit4:junit4]   2> 8835 T4707 oasc.SolrCore.close [collection1]  CLOSING
> SolrCore org.apache.solr.core.SolrCore@4c3c6254
> [junit4:junit4]   2> 8844 T4707 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,
> adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cum
> ulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 8845 T4707 oasc.SolrCore.decrefSolrCoreState Closing
> SolrCoreState
> [junit4:junit4]   2> 8845 T4707 oasu.DefaultSolrCoreState.closeIndexWriter
> SolrCoreState ref count has reached 0 - closing IndexWriter
> [junit4:junit4]   2> 8845 T4707 oasu.DefaultSolrCoreState.closeIndexWriter
> closing IndexWriter with IndexWriterCloser
> [junit4:junit4]   2> 8846 T4707 oasc.SolrCore.closeSearcher [collection1]
> Closing main searcher on request.
> [junit4:junit4]   2> 8847 T4707 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3/index
> [junit4:junit4]   2> 8847 T4707 oasc.CachingDirectoryFactory.close Closing
> directory when closing factory:/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index
> [junit4:junit4]   2> 8848 T4707 oasc.CachingDirectoryFactory.closeDirectory
> Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data3/index
> [junit4:junit4]   2> 8848 T4707 oasc.CachingDirectoryFactory.close Closing
> directory when closing factory:/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3
> [junit4:junit4]   2> 8849 T4707 oasc.CachingDirectoryFactory.closeDirectory
> Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data3
> [junit4:junit4]   2> 8850 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d0007
> [junit4:junit4]   2> 8851 T4720 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeChildrenChanged
> path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 8851 T4734 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeChildrenChanged
> path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 8851 T4734 oascc.ZkStateReader$2.process WARNING
> ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 8851 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57637 which had sessionid
> 0x13be13bb93d0007
> [junit4:junit4]   2> 8851 T4707 oaz.ZooKeeper.close Session:
> 0x13be13bb93d0007 closed
> [junit4:junit4]   2> 8851 T4728 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeChildrenChanged
> path:/live_nodes, has occurred - updating... (live nodes size: 3)
> [junit4:junit4]   2> 8852 T4734 oascc.ZkStateReader$3.process WARNING
> ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 8852 T4734 oaz.ClientCnxn$EventThread.run EventThread
> shut down
> [junit4:junit4]   2> 8858 T4720 oascc.ZkStateReader$3.process Updating live
> nodes... (2)
> [junit4:junit4]   2> 8859 T4728 oascc.ZkStateReader$3.process Updating live
> nodes... (2)
> [junit4:junit4]   2> 9056 T4728 oaz.ClientCnxn$EventThread.run EventThread
> shut down
> [junit4:junit4]   2> 9057 T4709 oazs.NIOServerCnxn.doIO WARNING caught
> end of stream exception EndOfStreamException: Unable to read additional
> data from client sessionid 0x13be13bb93d0005, likely client has closed socket
> [junit4:junit4]   2> 	at
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220
> )
> [junit4:junit4]   2> 	at
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFac
> tory.java:208)
> [junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 9056 T4707 oasc.CoreContainer.shutdown Shutting down
> CoreContainer instance=287074249
> [junit4:junit4]   2> 9058 T4707 oasc.SolrCore.close [collection1]  CLOSING
> SolrCore org.apache.solr.core.SolrCore@272c9b42
> [junit4:junit4]   2> 9059 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57635 which had sessionid
> 0x13be13bb93d0005
> [junit4:junit4]   2> 9062 T4707 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,
> adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cum
> ulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 9063 T4707 oasc.SolrCore.decrefSolrCoreState Closing
> SolrCoreState
> [junit4:junit4]   2> 9063 T4707 oasu.DefaultSolrCoreState.closeIndexWriter
> SolrCoreState ref count has reached 0 - closing IndexWriter
> [junit4:junit4]   2> 9064 T4707 oasu.DefaultSolrCoreState.closeIndexWriter
> closing IndexWriter with IndexWriterCloser
> [junit4:junit4]   2> 9064 T4707 oasc.SolrCore.closeSearcher [collection1]
> Closing main searcher on request.
> [junit4:junit4]   2> 9066 T4707 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data2/index
> [junit4:junit4]   2> 9067 T4707 oasc.CachingDirectoryFactory.close Closing
> directory when closing factory:/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2/index
> [junit4:junit4]   2> 9067 T4707 oasc.CachingDirectoryFactory.closeDirectory
> Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data2/index
> [junit4:junit4]   2> 9069 T4707 oasc.CachingDirectoryFactory.close Closing
> directory when closing factory:/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2
> [junit4:junit4]   2> 9069 T4707 oasc.CachingDirectoryFactory.closeDirectory
> Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data2
> [junit4:junit4]   2> 9071 T4707 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
> [junit4:junit4]   2> 9071 T4707 oasc.SolrResourceLoader.locateSolrHome solr
> home defaulted to 'solr/' (could not find system property or JNDI)
> [junit4:junit4]   2> 9072 T4707 oasc.CoreContainer$Initializer.initialize looking
> for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/solr/solr.xml
> [junit4:junit4]   2> 9072 T4707 oasc.CoreContainer.<init> New CoreContainer
> 1050006525
> [junit4:junit4]   2> 9073 T4707 oasc.CoreContainer$Initializer.initialize no
> solr.xml file found - using default
> [junit4:junit4]   2> 9074 T4707 oasc.CoreContainer.load Loading
> CoreContainer using Solr Home: 'solr/'
> [junit4:junit4]   2> 9075 T4707 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory: 'solr/'
> [junit4:junit4]   2> 9117 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 0
> [junit4:junit4]   2> 9117 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: http://
> [junit4:junit4]   2> 9118 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 0
> [junit4:junit4]   2> 9118 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
> [junit4:junit4]   2> 9119 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
> [junit4:junit4]   2> 9119 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
> [junit4:junit4]   2> 9119 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
> [junit4:junit4]   2> 9120 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
> [junit4:junit4]   2> 9120 T4707 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
> [junit4:junit4]   2> 9120 T4707 oascsi.HttpClientUtil.createClient Creating new
> http client,
> config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout
> =0&connTimeout=0&retry=false
> [junit4:junit4]   2> 9135 T4707 oasc.CoreContainer.load Registering Log
> Listener
> [junit4:junit4]   2> 9151 T4707 oasc.CoreContainer.initZooKeeper Zookeeper
> client=127.0.0.1:57629/solr
> [junit4:junit4]   2> 9152 T4707 oasc.ZkController.checkChrootPath zkHost
> includes chroot
> [junit4:junit4]   2> 9152 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629 sessionTimeout=60000
> watcher=org.apache.solr.common.cloud.ConnectionManager@6acd5cfc
> [junit4:junit4]   2> 9153 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 9153 T4740 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> 
> [junit4:junit4]   2> 9154 T4740 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 9155 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57639
> [junit4:junit4]   2> 9155 T4709
> oazs.ZooKeeperServer.processConnectRequest Client attempting to
> establish new session at /127.0.0.1:57639
> [junit4:junit4]   2> 9156 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d0009 with negotiated timeout 20000 for
> client /127.0.0.1:57639
> [junit4:junit4]   2> 9156 T4740 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d0009, negotiated timeout = 20000
> [junit4:junit4]   2> 9156 T4741 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@6acd5cfc
> name:ZooKeeperConnection Watcher:127.0.0.1:57629 got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 9157 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 9158 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d0009
> [junit4:junit4]   2> 9159 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57639 which had sessionid
> 0x13be13bb93d0009
> [junit4:junit4]   2> 9159 T4707 oaz.ZooKeeper.close Session:
> 0x13be13bb93d0009 closed
> [junit4:junit4]   2> 9160 T4741 oaz.ClientCnxn$EventThread.run EventThread
> shut down
> [junit4:junit4]   2> 9160 T4707 oascsi.HttpClientUtil.createClient Creating new
> http client,
> config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=
> 0&connTimeout=0
> [junit4:junit4]   2> 12135 T4710 oazs.ZooKeeperServer.expire Expiring session
> 0x13be13bb93d0005, timeout of 3000ms exceeded
> [junit4:junit4]   2> 14313 T4707 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629/solr sessionTimeout=3000
> watcher=org.apache.solr.common.cloud.ConnectionManager@5b927dbb
> [junit4:junit4]   2> 14314 T4719 oaz.ClientCnxn$SendThread.run Client session
> timed out, have not heard from server in 5455ms for sessionid
> 0x13be13bb93d0003, closing socket connection and attempting reconnect
> [junit4:junit4]   2> 14314 T4710 oazs.ZooKeeperServer.expire Expiring session
> 0x13be13bb93d0003, timeout of 3000ms exceeded
> [junit4:junit4]   2> 14315 T4709 oazs.NIOServerCnxn.doIO WARNING caught
> end of stream exception EndOfStreamException: Unable to read additional
> data from client sessionid 0x13be13bb93d0003, likely client has closed socket
> [junit4:junit4]   2> 	at
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220
> )
> [junit4:junit4]   2> 	at
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFac
> tory.java:208)
> [junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 14315 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d0005
> [junit4:junit4]   2> 14315 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d0003
> [junit4:junit4]   2> 14315 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57633 which had sessionid
> 0x13be13bb93d0003
> [junit4:junit4]   2> 14316 T4742 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> [junit4:junit4]   2> 14316 T4707 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 14317 T4742 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 14318 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57640
> [junit4:junit4]   2> 14318 T4709
> oazs.ZooKeeperServer.processConnectRequest Client attempting to
> establish new session at /127.0.0.1:57640
> [junit4:junit4]   2> 14319 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d000a with negotiated timeout 3000 for
> client /127.0.0.1:57640
> [junit4:junit4]   2> 14319 T4742 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d000a, negotiated timeout = 3000
> [junit4:junit4]   2> 14319 T4743 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@5b927dbb
> name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 14319 T4707 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 14320 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:create cxid:0x1 zxid:0x91 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 14321 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:create cxid:0x2 zxid:0x92 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 14323 T4707 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/192.168.57.17:8983_solr
> [junit4:junit4]   2> 14324 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:delete cxid:0x4 zxid:0x93 txntype:-1 reqpath:n/a Error
> Path:/solr/live_nodes/192.168.57.17:8983_solr Error:KeeperErrorCode =
> NoNode for /solr/live_nodes/192.168.57.17:8983_solr
> [junit4:junit4]   2> 14325 T4707 oascc.SolrZkClient.makePath makePath:
> /live_nodes/192.168.57.17:8983_solr
> [junit4:junit4]   2> 14332 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:delete cxid:0xd zxid:0x96 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for
> /solr/overseer_elect/leader
> [junit4:junit4]   2> 14333 T4707 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/leader
> [junit4:junit4]   2> 14337 T4707 oasc.Overseer.start Overseer
> (id=88912264290959370-192.168.57.17:8983_solr-n_0000000003) starting
> [junit4:junit4]   2> 14338 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:create cxid:0x12 zxid:0x98 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 14339 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:create cxid:0x13 zxid:0x99 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 14340 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:create cxid:0x14 zxid:0x9a txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 14342 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:create cxid:0x15 zxid:0x9b txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 14343 T4745 oasc.OverseerCollectionProcessor.run Process
> current queue of collection messages
> [junit4:junit4]   2> 14344 T4707
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating
> cluster state from ZooKeeper...
> [junit4:junit4]   2> 14347 T4744 oasc.Overseer$ClusterStateUpdater.run
> Starting to work on the main queue
> [junit4:junit4]   2> 14349 T4744 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 14350 T4744
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"testcore",
> [junit4:junit4]   2> 	  "collection":"testcore",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
> [junit4:junit4]   2> 14352 T4746 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using instanceDir: solr/collection1
> [junit4:junit4]   2> 14352 T4746 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:collection1
> [junit4:junit4]   2> 14353 T4746 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
> [junit4:junit4]   2> 14354 T4746 oasc.ZkController.readConfigName Load
> collection config from:/collections/collection1
> [junit4:junit4]   2> 14354 T4743 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 14356 T4746 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory: 'solr/collection1/'
> [junit4:junit4]   2> 14398 T4746 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_50
> [junit4:junit4]   2> 14415 T4720 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@14abeed
> name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event
> WatchedEvent state:Disconnected type:None path:null path:null type:None
> [junit4:junit4]   2> 14416 T4720 oascc.ConnectionManager.process zkClient
> has disconnected
> [junit4:junit4]   2> 14416 T4720
> oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path:
> null state: Disconnected type None
> [junit4:junit4]   2> 14476 T4746 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
> [junit4:junit4]   2> 14478 T4746 oass.IndexSchema.readSchema Reading Solr
> Schema
> [junit4:junit4]   2> 14485 T4746 oass.IndexSchema.readSchema Schema
> name=test
> [junit4:junit4]   2> 15076 T4746 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> [junit4:junit4]   2> 15086 T4746 oass.IndexSchema.readSchema default
> search field in schema is text
> [junit4:junit4]   2> 15091 T4746 oass.IndexSchema.readSchema unique key
> field: id
> [junit4:junit4]   2> 15112 T4746 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 15118 T4746 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> [junit4:junit4]   2> 15136 T4746 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 15138 T4746 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> [junit4:junit4]   2> 15140 T4746 oasc.SolrCore.<init> [collection1] Opening
> new SolrCore at solr/collection1/, dataDir=/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/
> [junit4:junit4]   2> 15141 T4746 oasc.JmxMonitoredMap.<init> JMX
> monitoring is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@c96ad7c
> [junit4:junit4]   2> 15141 T4746 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
> [junit4:junit4]   2> 15142 T4746 oasc.CachingDirectoryFactory.get return new
> directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3 forceNew:false
> [junit4:junit4]   2> 15142 T4746 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3
> [junit4:junit4]   2> 15143 T4746 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null new=/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3/index/
> [junit4:junit4]   2> 15143 T4746 oasc.SolrCore.initIndex WARNING
> [collection1] Solr index directory '/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index'
> doesn't exist. Creating new index...
> [junit4:junit4]   2> 15144 T4746 oasc.CachingDirectoryFactory.get return new
> directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3/index forceNew:false
> [junit4:junit4]   2> 15145 T4746 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits:num=1
> [junit4:junit4]   2>
> 	commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apa
> che.lucene.store.RAMDirectory@69e8ab02
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@c61c805)),segFN
> =segments_1,generation=1,filenames=[segments_1]
> [junit4:junit4]   2> 15145 T4746 oasc.SolrDeletionPolicy.updateCommits
> newest commit = 1[segments_1]
> [junit4:junit4]   2> 15146 T4746 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3/index
> [junit4:junit4]   2> 15146 T4746 oasc.SolrCore.initWriters created xml:
> solr.XMLResponseWriter
> [junit4:junit4]   2> 15148 T4746 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
> [junit4:junit4]   2> 15149 T4746 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe-allfields"
> [junit4:junit4]   2> 15149 T4746 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
> [junit4:junit4]   2> 15149 T4746 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "uniq-fields"
> [junit4:junit4]   2> 15150 T4746 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> [junit4:junit4]   2> 15150 T4746
> oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
> solr.ReplicationHandler
> [junit4:junit4]   2> 15151 T4746
> oasc.RequestHandlers.initHandlersFromConfig created /replication:
> solr.ReplicationHandler
> [junit4:junit4]   2> 15151 T4746
> oasc.RequestHandlers.initHandlersFromConfig created standard:
> solr.StandardRequestHandler
> [junit4:junit4]   2> 15152 T4746
> oasc.RequestHandlers.initHandlersFromConfig created /get:
> solr.RealTimeGetHandler
> [junit4:junit4]   2> 15152 T4746
> oasc.RequestHandlers.initHandlersFromConfig created dismax:
> solr.SearchHandler
> [junit4:junit4]   2> 15152 T4746
> oasc.RequestHandlers.initHandlersFromConfig created mock:
> org.apache.solr.core.MockQuerySenderListenerReqHandler
> [junit4:junit4]   2> 15153 T4746
> oasc.RequestHandlers.initHandlersFromConfig created /admin/:
> org.apache.solr.handler.admin.AdminHandlers
> [junit4:junit4]   2> 15153 T4746
> oasc.RequestHandlers.initHandlersFromConfig created defaults:
> solr.StandardRequestHandler
> [junit4:junit4]   2> 15154 T4746
> oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
> solr.StandardRequestHandler
> [junit4:junit4]   2> 15154 T4746
> oasc.RequestHandlers.initHandlersFromConfig created lazy:
> solr.StandardRequestHandler
> [junit4:junit4]   2> 15154 T4746
> oasc.RequestHandlers.initHandlersFromConfig created /update:
> solr.UpdateRequestHandler
> [junit4:junit4]   2> 15155 T4746
> oasc.RequestHandlers.initHandlersFromConfig created /terms:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 15155 T4746
> oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 15157 T4746
> oasc.RequestHandlers.initHandlersFromConfig created
> spellCheckCompRH_Direct:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 15157 T4746
> oasc.RequestHandlers.initHandlersFromConfig created
> spellCheckWithWordbreak:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 15158 T4746
> oasc.RequestHandlers.initHandlersFromConfig created
> spellCheckWithWordbreak_Direct:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 15158 T4746
> oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 15158 T4746
> oasc.RequestHandlers.initHandlersFromConfig created mltrh:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 15159 T4746
> oasc.RequestHandlers.initHandlersFromConfig created tvrh:
> org.apache.solr.handler.component.SearchHandler
> [junit4:junit4]   2> 15159 T4746
> oasc.RequestHandlers.initHandlersFromConfig created /mlt:
> solr.MoreLikeThisHandler
> [junit4:junit4]   2> 15160 T4746
> oasc.RequestHandlers.initHandlersFromConfig created /debug/dump:
> solr.DumpRequestHandler
> [junit4:junit4]   2> 15163 T4746 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> [junit4:junit4]   2> 15165 T4746 oasc.SolrCore.initDeprecatedSupport
> WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please
> update your config to use the ShowFileRequestHandler.
> [junit4:junit4]   2> 15167 T4746 oasc.SolrCore.initDeprecatedSupport
> WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML,
> OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-
> EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-
> ISOLATIN1ACCENT.TXT]
> [junit4:junit4]   2> 15168 T4746 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3
> [junit4:junit4]   2> 15169 T4746 oass.SolrIndexSearcher.<init> Opening
> Searcher@17c62813 main
> [junit4:junit4]   2> 15170 T4746 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
> [junit4:junit4]   2> 15170 T4746 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
> [junit4:junit4]   2> 15170 T4746 oashc.SpellCheckComponent.inform
> Initializing spell checkers
> [junit4:junit4]   2> 15172 T4746 oass.DirectSolrSpellChecker.init init:
> {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLe
> ngth=3}
> [junit4:junit4]   2> 15186 T4747 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@17c62813
> main{StandardDirectoryReader(segments_1:1)}
> [junit4:junit4]   2> 15188 T4746 oasc.ZkController.publish publishing
> core=collection1 state=down
> [junit4:junit4]   2> 15188 T4746 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
> [junit4:junit4]   2> 15376 T4744 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 15377 T4744
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":null,
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"192.168.57.17:8983_solr",
> [junit4:junit4]   2> 	  "base_url":"http://192.168.57.17:8983/solr"}
> [junit4:junit4]   2> 15377 T4744
> oasc.Overseer$ClusterStateUpdater.updateState Collection already exists
> with numShards=1
> [junit4:junit4]   2> 15378 T4744
> oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to
> shard shard=shard1
> [junit4:junit4]   2> 15385 T4743 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 16030 T4719 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> [junit4:junit4]   2> 16032 T4719 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 16034 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57641
> [junit4:junit4]   2> 16036 T4709
> oazs.ZooKeeperServer.processConnectRequest Client attempting to renew
> session 0x13be13bb93d0003 at /127.0.0.1:57641
> [junit4:junit4]   2> 16037 T4709 oazs.ZooKeeperServer.finishSessionInit
> Invalid session 0x13be13bb93d0003 for client /127.0.0.1:57641, probably
> expired
> [junit4:junit4]   2> 16038 T4720 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@14abeed
> name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event
> WatchedEvent state:Expired type:None path:null path:null type:None
> [junit4:junit4]   2> 16039 T4720 oascc.ConnectionManager.process Our
> previous ZooKeeper session was expired. Attempting to reconnect to
> recover relationship with ZooKeeper...
> [junit4:junit4]   2> 16037 T4719 oaz.ClientCnxn$SendThread.run Unable to
> reconnect to ZooKeeper service, session 0x13be13bb93d0003 has expired,
> closing socket connection
> [junit4:junit4]   2> 16039 T4720 oascc.DefaultConnectionStrategy.reconnect
> Connection expired - starting a new one...
> [junit4:junit4]   2> 16038 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57641 which had sessionid
> 0x13be13bb93d0003
> [junit4:junit4]   2> 16041 T4720 oaz.ZooKeeper.<init> Initiating client
> connection, connectString=127.0.0.1:57629/solr sessionTimeout=3000
> watcher=org.apache.solr.common.cloud.ConnectionManager@14abeed
> [junit4:junit4]   2> 16043 T4720 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> [junit4:junit4]   2> 16044 T4748 oaz.ClientCnxn$SendThread.logStartConnect
> Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not
> attempt to authenticate using SASL (access denied
> (javax.security.auth.AuthPermission getLoginConfiguration))
> [junit4:junit4]   2> 16048 T4748 oaz.ClientCnxn$SendThread.primeConnection
> Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
> [junit4:junit4]   2> 16048 T4709 oazs.NIOServerCnxnFactory.run Accepted
> socket connection from /127.0.0.1:57642
> [junit4:junit4]   2> 16049 T4709
> oazs.ZooKeeperServer.processConnectRequest Client attempting to
> establish new session at /127.0.0.1:57642
> [junit4:junit4]   2> 16053 T4748 oaz.ClientCnxn$SendThread.onConnected
> Session establishment complete on server 127.0.0.1/127.0.0.1:57629,
> sessionid = 0x13be13bb93d000b, negotiated timeout = 3000
> [junit4:junit4]   2> 16052 T4711 oazs.ZooKeeperServer.finishSessionInit
> Established session 0x13be13bb93d000b with negotiated timeout 3000 for
> client /127.0.0.1:57642
> [junit4:junit4]   2> 16053 T4749 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@14abeed
> name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null
> type:None
> [junit4:junit4]   2> 16055 T4720 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> [junit4:junit4]   2> 16055 T4720 oascc.ConnectionManager$1.update
> Connection with ZooKeeper reestablished.
> [junit4:junit4]   2> 16056 T4720 oasc.ZkController.publish publishing
> core=collection1 state=down
> [junit4:junit4]   2> 16056 T4720 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
> [junit4:junit4]   2> 16155 T4721
> oasc.Overseer$ClusterStateUpdater.amILeader WARNING
> org.apache.zookeeper.KeeperException$SessionExpiredException:
> KeeperErrorCode = Session expired for /overseer_elect/leader
> [junit4:junit4]   2> 	at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
> [junit4:junit4]   2> 	at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> [junit4:junit4]   2> 	at
> org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
> [junit4:junit4]   2> 	at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
> [junit4:junit4]   2> 	at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
> [junit4:junit4]   2> 	at
> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecu
> tor.java:65)
> [junit4:junit4]   2> 	at
> org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
> [junit4:junit4]   2> 	at
> org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.j
> ava:200)
> [junit4:junit4]   2> 	at
> org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:123
> )
> [junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 16155 T4722 oasc.OverseerCollectionProcessor.run
> WARNING Overseer cannot talk to ZK
> [junit4:junit4]   2> 16157 T4721
> oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I
> (id=88912264290959363-127.0.0.1:1661_solr-n_0000000000) am no longer a
> leader.
> [junit4:junit4]   2> 16191 T4746 oasc.CoreContainer.registerCore registering
> core: collection1
> [junit4:junit4]   2> 16191 T4746 oasc.ZkController.register Register replica -
> core:collection1 address:http://192.168.57.17:8983/solr collection:collection1
> shard:shard1
> [junit4:junit4]   2> 16199 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:delete cxid:0x6c zxid:0xa8 txntype:-1 reqpath:n/a Error
> Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode =
> NoNode for /solr/collections/collection1/leaders/shard1
> [junit4:junit4]   2> 16202 T4746
> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader
> process.
> [junit4:junit4]   2> 16204 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:create cxid:0x6d zxid:0xa9 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 16210 T4746
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until
> we see more replicas up: total=4 found=1 timeoutin=179999
> [junit4:junit4]   2> 16403 T4744 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 16404 T4744
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
> [junit4:junit4]   2> 16418 T4743 oascc.ZkStateReader$2.process A cluster state
> change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 36337 T4746
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until
> we see more replicas up: total=4 found=1 timeoutin=159872
> [junit4:junit4]   2> 46149 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> Could not get leader props
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2> 	Caused by:
> org.apache.zookeeper.KeeperException$NoNodeException:
> KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecu
> tor.java:65)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
> [junit4:junit4]   2> 		... 10 more
> [junit4:junit4]   2>
> [junit4:junit4]   2> 56462 T4746
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until
> we see more replicas up: total=4 found=1 timeoutin=139747
> [junit4:junit4]   2> 76613 T4746
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until
> we see more replicas up: total=4 found=1 timeoutin=119596
> [junit4:junit4]   2> 78242 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> Could not get leader props
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2> 	Caused by:
> org.apache.zookeeper.KeeperException$NoNodeException:
> KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecu
> tor.java:65)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
> [junit4:junit4]   2> 		... 10 more
> [junit4:junit4]   2>
> [junit4:junit4]   2> 96710 T4746
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until
> we see more replicas up: total=4 found=1 timeoutin=99499
> [junit4:junit4]   2> 110340 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> Could not get leader props
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2> 	Caused by:
> org.apache.zookeeper.KeeperException$NoNodeException:
> KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecu
> tor.java:65)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
> [junit4:junit4]   2> 		... 10 more
> [junit4:junit4]   2>
> [junit4:junit4]   2> 116820 T4746
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until
> we see more replicas up: total=4 found=1 timeoutin=79389
> [junit4:junit4]   2> 136933 T4746
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until
> we see more replicas up: total=4 found=1 timeoutin=59276
> [junit4:junit4]   2> 142416 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> Could not get leader props
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2> 	Caused by:
> org.apache.zookeeper.KeeperException$NoNodeException:
> KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecu
> tor.java:65)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
> [junit4:junit4]   2> 		... 10 more
> [junit4:junit4]   2>
> [junit4:junit4]   2> 157042 T4746
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until
> we see more replicas up: total=4 found=1 timeoutin=39167
> [junit4:junit4]   2> 174502 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> Could not get leader props
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2> 	Caused by:
> org.apache.zookeeper.KeeperException$NoNodeException:
> KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecu
> tor.java:65)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
> [junit4:junit4]   2> 		... 10 more
> [junit4:junit4]   2>
> [junit4:junit4]   2> 177180 T4746
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until
> we see more replicas up: total=4 found=1 timeoutin=19029
> [junit4:junit4]   2> 196281 T4746
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Was waiting for
> replicas to come up, but they are taking too long - assuming they won't come
> back till later
> [junit4:junit4]   2> 196282 T4746
> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader
> - try and sync
> [junit4:junit4]   2> 196283 T4746
> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
> http://192.168.57.17:8983/solr/collection1/
> [junit4:junit4]   2> 196284 T4746 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/leaders/shard1
> [junit4:junit4]   2> 196296 T4712 oazs.PrepRequestProcessor.pRequest Got
> user-level KeeperException when processing sessionid:0x13be13bb93d000a
> type:create cxid:0x622 zxid:0xb3 txntype:-1 reqpath:n/a Error
> Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
> [junit4:junit4]   2> 196555 T4720 oasc.ZkController.publish publishing
> core=testcore state=down
> [junit4:junit4]   2> 196555 T4720 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
> [junit4:junit4]   2> 196685 T4744 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 196692 T4744
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"down",
> [junit4:junit4]   2> 	  "core":"testcore",
> [junit4:junit4]   2> 	  "collection":"testcore",
> [junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
> [junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
> [junit4:junit4]   2> 196699 T4743 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 196735 T4746 oasc.ZkController.register We are
> http://192.168.57.17:8983/solr/collection1/ and leader is
> http://192.168.57.17:8983/solr/collection1/
> [junit4:junit4]   2> 196735 T4746 oasc.ZkController.checkRecovery WARNING
> Skipping recovery according to sys prop solrcloud.skip.autorecovery
> [junit4:junit4]   2> 196736 T4746 oasc.ZkController.publish publishing
> core=collection1 state=active
> [junit4:junit4]   2> 196736 T4746 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
> [junit4:junit4]   2> 196739 T4746 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 197211 T4744 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> [junit4:junit4]   2> 197212 T4744
> oasc.Overseer$ClusterStateUpdater.updateState Update state
> numShards=null message={
> [junit4:junit4]   2> 	  "operation":"state",
> [junit4:junit4]   2> 	  "numShards":null,
> [junit4:junit4]   2> 	  "shard":"shard1",
> [junit4:junit4]   2> 	  "roles":null,
> [junit4:junit4]   2> 	  "state":"active",
> [junit4:junit4]   2> 	  "core":"collection1",
> [junit4:junit4]   2> 	  "collection":"collection1",
> [junit4:junit4]   2> 	  "node_name":"192.168.57.17:8983_solr",
> [junit4:junit4]   2> 	  "base_url":"http://192.168.57.17:8983/solr"}
> [junit4:junit4]   2> 197219 T4743 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> [junit4:junit4]   2> 217055 T4707 oasc.CoreContainer.shutdown Shutting
> down CoreContainer instance=348292905
> [junit4:junit4]   2> 217056 T4707 oasc.SolrCore.close [collection1]  CLOSING
> SolrCore org.apache.solr.core.SolrCore@36b3a26b
> [junit4:junit4]   2> 217062 T4707 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,
> adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cum
> ulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 217063 T4707 oasc.SolrCore.decrefSolrCoreState Closing
> SolrCoreState
> [junit4:junit4]   2> 217063 T4707 oasu.DefaultSolrCoreState.closeIndexWriter
> SolrCoreState ref count has reached 0 - closing IndexWriter
> [junit4:junit4]   2> 217064 T4707 oasu.DefaultSolrCoreState.closeIndexWriter
> closing IndexWriter with IndexWriterCloser
> [junit4:junit4]   2> 217065 T4707 oasc.SolrCore.closeSearcher [collection1]
> Closing main searcher on request.
> [junit4:junit4]   2> 217066 T4707 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data1/index
> [junit4:junit4]   2> 217066 T4707 oasc.CachingDirectoryFactory.close Closing
> directory when closing factory:/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1
> [junit4:junit4]   2> 217067 T4707 oasc.CachingDirectoryFactory.closeDirectory
> Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data1
> [junit4:junit4]   2> 217067 T4707 oasc.CachingDirectoryFactory.close Closing
> directory when closing factory:/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1/index
> [junit4:junit4]   2> 217068 T4707 oasc.CachingDirectoryFactory.closeDirectory
> Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data1/index
> [junit4:junit4]   2> 217068 T4707 oasc.SolrCore.close [testcore]  CLOSING
> SolrCore org.apache.solr.core.SolrCore@1c39197c
> [junit4:junit4]   2> 217078 T4707 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,
> adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cum
> ulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 217079 T4707 oasc.SolrCore.decrefSolrCoreState Closing
> SolrCoreState
> [junit4:junit4]   2> 217079 T4707 oasu.DefaultSolrCoreState.closeIndexWriter
> SolrCoreState ref count has reached 0 - closing IndexWriter
> [junit4:junit4]   2> 217080 T4707 oasu.DefaultSolrCoreState.closeIndexWriter
> closing IndexWriter with IndexWriterCloser
> [junit4:junit4]   2> 217080 T4707 oasc.SolrCore.closeSearcher [testcore]
> Closing main searcher on request.
> [junit4:junit4]   2> 217081 T4707 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data4/index
> [junit4:junit4]   2> 217081 T4707 oasc.CachingDirectoryFactory.close Closing
> directory when closing factory:/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4/index
> [junit4:junit4]   2> 217082 T4707 oasc.CachingDirectoryFactory.closeDirectory
> Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data4/index
> [junit4:junit4]   2> 217082 T4707 oasc.CachingDirectoryFactory.close Closing
> directory when closing factory:/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4
> [junit4:junit4]   2> 217083 T4707 oasc.CachingDirectoryFactory.closeDirectory
> Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data4
> [junit4:junit4]   2> 217084 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d000b
> [junit4:junit4]   2> 217085 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57642 which had sessionid
> 0x13be13bb93d000b
> [junit4:junit4]   2> 217085 T4707 oaz.ZooKeeper.close Session:
> 0x13be13bb93d000b closed
> [junit4:junit4]   2> 217085 T4749 oaz.ClientCnxn$EventThread.run
> EventThread shut down
> [junit4:junit4]   2> 217086 T4707 oasc.CoreContainer.shutdown Shutting
> down CoreContainer instance=1050006525
> [junit4:junit4]   2> 217086 T4707 oasc.SolrCore.close [collection1]  CLOSING
> SolrCore org.apache.solr.core.SolrCore@6d346c33
> [junit4:junit4]   2> 217097 T4707 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,
> adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cum
> ulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
> [junit4:junit4]   2> 217098 T4707 oasc.SolrCore.decrefSolrCoreState Closing
> SolrCoreState
> [junit4:junit4]   2> 217098 T4707 oasu.DefaultSolrCoreState.closeIndexWriter
> SolrCoreState ref count has reached 0 - closing IndexWriter
> [junit4:junit4]   2> 217099 T4707 oasu.DefaultSolrCoreState.closeIndexWriter
> closing IndexWriter with IndexWriterCloser
> [junit4:junit4]   2> 217099 T4707 oasc.SolrCore.closeSearcher [collection1]
> Closing main searcher on request.
> [junit4:junit4]   2> 217100 T4707 oasc.CachingDirectoryFactory.close Releasing
> directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-
> 1356693485871/data3/index
> [junit4:junit4]   2> 217101 T4707 oasc.CachingDirectoryFactory.close Closing
> directory when closing factory:/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3
> [junit4:junit4]   2> 217101 T4707 oasc.CachingDirectoryFactory.closeDirectory
> Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data3
> [junit4:junit4]   2> 217102 T4707 oasc.CachingDirectoryFactory.close Closing
> directory when closing factory:/Users/jenkins/jenkins-
> slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-
> core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index
> [junit4:junit4]   2> 217102 T4707 oasc.CachingDirectoryFactory.closeDirectory
> Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-
> trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-
> ClusterStateUpdateTest-1356693485871/data3/index
> [junit4:junit4]   2> 217106 T4744
> oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I
> (id=88912264290959370-192.168.57.17:8983_solr-n_0000000003) am no
> longer a leader.
> [junit4:junit4]   2> 217107 T4712 oazs.PrepRequestProcessor.pRequest2Txn
> Processed session termination for sessionid: 0x13be13bb93d000a
> [junit4:junit4]   2> 217110 T4709 oazs.NIOServerCnxn.closeSock Closed socket
> connection for client /127.0.0.1:57640 which had sessionid
> 0x13be13bb93d000a
> [junit4:junit4]   2> 217110 T4707 oaz.ZooKeeper.close Session:
> 0x13be13bb93d000a closed
> [junit4:junit4]   2> 217111 T4707 oasc.CoreContainer.shutdown Shutting
> down CoreContainer instance=1535165846
> [junit4:junit4]   2> 217111 T4707 oazs.ZooKeeperServer.shutdown shutting
> down
> [junit4:junit4]   2> 217112 T4707 oazs.SessionTrackerImpl.shutdown Shutting
> down
> [junit4:junit4]   2> 217112 T4707 oazs.PrepRequestProcessor.shutdown
> Shutting down
> [junit4:junit4]   2> 217113 T4712 oazs.PrepRequestProcessor.run
> PrepRequestProcessor exited loop!
> [junit4:junit4]   2> 217113 T4707 oazs.SyncRequestProcessor.shutdown
> Shutting down
> [junit4:junit4]   2> 217118 T4711 oazs.SyncRequestProcessor.run
> SyncRequestProcessor exited!
> [junit4:junit4]   2> 217119 T4707 oazs.FinalRequestProcessor.shutdown
> shutdown of request processor complete
> [junit4:junit4]   2> 217135 T4710 oazs.SessionTrackerImpl.run
> SessionTrackerImpl exited loop!
> [junit4:junit4]   2> 217228 T4707 oasc.ZkTestServer.send4LetterWord
> connecting to 127.0.0.1:57629 57629
> [junit4:junit4]   2> 217324 T4709 oazs.NIOServerCnxnFactory.run
> NIOServerCnxn factory exited run method
> [junit4:junit4]   2> 217326 T4707 oazs.ZooKeeperServer.shutdown shutting
> down
> [junit4:junit4]   2> 217327 T4707 oazs.SessionTrackerImpl.shutdown Shutting
> down
> [junit4:junit4]   2> 217327 T4707 oazs.PrepRequestProcessor.shutdown
> Shutting down
> [junit4:junit4]   2> 217327 T4707 oazs.SyncRequestProcessor.shutdown
> Shutting down
> [junit4:junit4]   2> 217327 T4707 oazs.FinalRequestProcessor.shutdown
> shutdown of request processor complete
> [junit4:junit4]   2> 217328 T4707 oas.SolrTestCaseJ4.tearDown ###Ending
> testCoreRegistration
> [junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -
> Dtestcase=ClusterStateUpdateTest -Dtests.method=testCoreRegistration -
> Dtests.seed=D918F8FA64E198EA -Dtests.slow=true -Dtests.locale=fr_CH -
> Dtests.timezone=America/Cancun -Dtests.file.encoding=MacRoman
> [junit4:junit4] FAILURE  217s | ClusterStateUpdateTest.testCoreRegistration
> <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError
> [junit4:junit4]    > 	at
> __randomizedtesting.SeedInfo.seed([D918F8FA64E198EA:67939E551D9B96D
> F]:0)
> [junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:92)
> [junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
> [junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:54)
> [junit4:junit4]    > 	at
> org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterS
> tateUpdateTest.java:234)
> [junit4:junit4]    > 	at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    > 	at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:39)
> [junit4:junit4]    > 	at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:25)
> [junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
> dRunner.java:1559)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
> mizedRunner.java:79)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
> mizedRunner.java:737)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
> mizedRunner.java:773)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
> mizedRunner.java:787)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.
> evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
> SetupTeardownChained.java:50)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
> cheSanity.java:51)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
> readAndTestName.java:49)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
> (ThreadLeakControl.java:782)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
> eakControl.java:442)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
> domizedRunner.java:746)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
> mizedRunner.java:648)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
> mizedRunner.java:682)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
> mizedRunner.java:693)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.
> evaluate(SystemPropertiesRestoreRule.java:53)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
> fterRule.java:46)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
> assName.java:42)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
> .evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
> ertionsRequired.java:43)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
> .java:48)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
> IgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    > 	at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
> TestSuites.java:55)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
> ementAdapter.java:36)
> [junit4:junit4]    > 	at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
> run(ThreadLeakControl.java:358)
> [junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:680)
> [junit4:junit4]   2> 217338 T4707 oas.SolrTestCaseJ4.deleteCore
> ###deleteCore
> [junit4:junit4]   2> 217392 T4706 ccr.ThreadLeakControl.checkThreadLeaks
> WARNING Will linger awaiting termination of 2 leaked thread(s).
> [junit4:junit4]   2> 217612 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> CoreContainer is shutdown
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 218411 T4743 oascc.ZkStateReader$3.process WARNING
> ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 218412 T4743 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected
> type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live
> nodes size: 1)
> [junit4:junit4]   2> 218412 T4743 oascc.ZkStateReader$2.process WARNING
> ZooKeeper watch triggered, but Solr cannot talk to ZK
> [junit4:junit4]   2> 218412 T4743 oaz.ClientCnxn$EventThread.run
> EventThread shut down
> [junit4:junit4]   2> 220615 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> CoreContainer is shutdown
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 223618 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> CoreContainer is shutdown
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 226621 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> CoreContainer is shutdown
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 229628 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> CoreContainer is shutdown
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 232637 T4720 oasc.SolrException.log SEVERE There was a
> problem finding the leader in zk:org.apache.solr.common.SolrException:
> CoreContainer is shutdown
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1169)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 234641 T4720 oasc.SolrException.log SEVERE
> :org.apache.solr.common.SolrException: There was a problem finding the
> leader in zk
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkContro
> ller.java:1179)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.jav
> a:277)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 234642 T4720 oasc.SolrException.log SEVERE
> :org.apache.zookeeper.KeeperException$SessionExpiredException:
> KeeperErrorCode = Session expired for
> /overseer_elect/election/88912264290959371-127.0.0.1:1661_solr-n_
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:293)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:220)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:197)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2>
> [junit4:junit4]   2> 234643 T4720 oasc.SolrException.log SEVERE Reconnect to
> ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException:
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:225)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionM
> anager.java:117)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(Defaul
> tConnectionStrategy.java:46)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.ConnectionManager.process(ConnectionMa
> nager.java:91)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.ja
> va:519)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
> [junit4:junit4]   2> 	Caused by:
> org.apache.zookeeper.KeeperException$SessionExpiredException:
> KeeperErrorCode = Session expired for
> /overseer_elect/election/88912264290959371-127.0.0.1:1661_solr-n_
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> [junit4:junit4]   2> 		at
> org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
> [junit4:junit4]   2> 		at
> org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:293)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:220)
> [junit4:junit4]   2> 		at
> org.apache.solr.cloud.ZkController$1.command(ZkController.java:197)
> [junit4:junit4]   2> 		... 5 more
> [junit4:junit4]   2>
> [junit4:junit4]   2> 234644 T4720 oascc.DefaultConnectionStrategy.reconnect
> Reconnect to ZooKeeper failed
> [junit4:junit4]   2> 234644 T4720 oascc.ConnectionManager.process
> Connected:true
> [junit4:junit4]   2> 234645 T4720
> oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path:
> null state: Expired type None
> [junit4:junit4]   2> 234645 T4720 oaz.ClientCnxn$EventThread.run
> EventThread shut down
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40,
> sim=DefaultSimilarity, locale=fr_CH, timezone=America/Cancun
> [junit4:junit4]   2> NOTE: Mac OS X 10.8.2 x86_64/Apple Inc. 1.6.0_37 (64-
> bit)/cpus=2,threads=1,free=131498952,total=276488192
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [IndexReaderFactoryTest,
> ConvertedLegacyTest, SpellCheckCollatorTest,
> LeaderElectionIntegrationTest, SpellingQueryConverterTest,
> TermVectorComponentDistributedTest, TestRealTimeGet,
> QueryEqualityTest, TestStressReorder, TestConfig, ZkNodePropsTest,
> CacheHeaderTest, SolrInfoMBeanTest, SolrRequestParserTest,
> SyncSliceTest, TestSolrQueryParser, TimeZoneUtilsTest, ScriptEngineTest,
> ExternalFileFieldSortTest, ReturnFieldsTest, TestFoldingMultitermQuery,
> PeerSyncTest, TestRTGBase, TestExtendedDismaxParser, CurrencyFieldTest,
> ZkCLITest, FullSolrCloudDistribCmdsTest, URLClassifyProcessorTest,
> DirectSolrConnectionTest, ZkSolrClientTest, BasicFunctionalityTest,
> TestQueryTypes, TestQuerySenderNoQuery, TestWriterPerf,
> TestPropInjectDefaults, TestPerFieldSimilarity, RequiredFieldsTest,
> OverseerTest, TestUpdate, TestLFUCache, TestSort,
> TestLMDirichletSimilarityFactory, TestIBSimilarityFactory,
> TestSystemIdResolver, TestStressRecovery, TestJmxMonitoredMap,
> TermVectorComponentTest, MBeansHandlerTest,
> IndexBasedSpellCheckerTest, TestQuerySenderListener,
> BinaryUpdateRequestHandlerTest, TestDocumentBuilder, SuggesterFSTTest,
> LukeRequestHandlerTest, TestStressVersions, SuggesterWFSTTest,
> JsonLoaderTest, PathHierarchyTokenizerFactoryTest,
> SolrCoreCheckLockOnStartupTest, SystemInfoHandlerTest, TestRecovery,
> PluginInfoTest, SolrCmdDistributorTest, WordBreakSolrSpellCheckerTest,
> TestCoreContainer, TestCSVLoader, TestQueryUtils, BadComponentTest,
> DocumentAnalysisRequestHandlerTest, TestReload, MultiTermTest,
> FastVectorHighlighterTest, TestNumberUtils, TestPseudoReturnFields,
> TestFastWriter, TestFuzzyAnalyzedSuggestions, TestAnalyzedSuggestions,
> DebugComponentTest, PolyFieldTest, TestOmitPositions, SimpleFacetsTest,
> TestBinaryResponseWriter, DirectSolrSpellCheckerTest, JSONWriterTest,
> TestPHPSerializedResponseWriter, TestReversedWildcardFilterFactory,
> TestPhraseSuggestions, DateMathParserTest, OutputWriterTest,
> TestSearchPerf, TestCSVResponseWriter, TestMergePolicyConfig, TestUtils,
> TestIndexingPerformance, TestCharFilters,
> DistributedTermsComponentTest, TestFunctionQuery,
> TestValueSourceCache, AlternateDirectoryTest,
> XmlUpdateRequestHandlerTest, UpdateRequestProcessorFactoryTest,
> BadIndexSchemaTest, DateFieldTest, TestDefaultSimilarityFactory,
> MoreLikeThisHandlerTest, TestDistributedSearch, StatsComponentTest,
> SuggesterTSTTest, SuggesterTest, FileBasedSpellCheckerTest,
> ShardRoutingCustomTest, HighlighterConfigTest, TestSolrXMLSerializer,
> OverseerCollectionProcessorTest, CopyFieldTest,
> CollectionsAPIDistributedZkTest, BasicDistributedZkTest, RecoveryZkTest,
> SpellCheckComponentTest, TestReplicationHandler, LeaderElectionTest,
> DistributedSpellCheckComponentTest, ZkControllerTest,
> TestDistributedGrouping, TestRandomFaceting, SoftAutoCommitTest,
> AutoCommitTest, BasicZkTest, TestFaceting, TestHashPartitioner, TestJoin,
> SolrCoreTest, TestRangeQuery, DirectUpdateHandlerTest,
> TestMultiCoreConfBootstrap, TestGroupingSearch, TestFiltering,
> QueryElevationComponentTest, SortByFunctionTest,
> SignatureUpdateProcessorFactoryTest, TestJmxIntegration, SampleTest,
> HighlighterTest, TestIndexSearcher, CoreAdminHandlerTest, TestTrie,
> TestRemoteStreaming, TestWordDelimiterFilterFactory, SpatialFilterTest,
> DocumentBuilderTest, DistributedQueryElevationComponentTest,
> DisMaxRequestHandlerTest, IndexSchemaTest, QueryParsingTest,
> TermsComponentTest, DistanceFunctionTest,
> XsltUpdateRequestHandlerTest, MinimalSchemaTest,
> StandardRequestHandlerTest, FieldAnalysisRequestHandlerTest,
> PingRequestHandlerTest, TestSurroundQueryParser,
> DirectUpdateHandlerOptimizeTest, IndexSchemaRuntimeFieldTest,
> SolrPluginUtilsTest, RequestHandlersTest, SearchHandlerTest,
> TestArbitraryIndexDir, LoggingHandlerTest,
> UniqFieldsUpdateProcessorFactoryTest, UpdateParamsTest,
> CSVRequestHandlerTest, ShowFileRequestHandlerTest,
> NotRequiredUniqueKeyTest, TestSolrDeletionPolicy1,
> TestLuceneMatchVersion, TestPropInject, NoCacheHeaderTest,
> PrimitiveFieldTypeTest, FieldMutatingUpdateProcessorTest, TestBinaryField,
> TestSolrDeletionPolicy2, SOLR749Test, DefaultValueUpdateProcessorTest,
> TestXIncludeConfig, TestDocSet, TestCollationField, SolrIndexConfigTest,
> NumericFieldsTest, TestSolrCoreProperties, EchoParamsTest,
> SpellPossibilityIteratorTest, TestBM25SimilarityFactory, TestPluginEnable,
> LegacyHTMLStripCharFilterTest, TestLMJelinekMercerSimilarityFactory,
> TestDFRSimilarityFactory, TestCodecSupport, TestFastLRUCache,
> PrimUtilsTest, OpenExchangeRatesOrgProviderTest, ResourceLoaderTest,
> FileUtilsTest, TestSuggestSpellingConverter, TestBadConfig, DOMUtilTest,
> TestLRUCache, ChaosMonkeySafeLeaderTest, UUIDFieldTest,
> RAMDirectoryFactoryTest, PreAnalyzedFieldTest, CircularListTest,
> AnalysisAfterCoreReloadTest, BasicDistributedZk2Test, ClusterStateTest,
> ClusterStateUpdateTest]
> [junit4:junit4] Completed in 234.89s, 1 test, 1 failure <<< FAILURES!
> 
> [...truncated 56 lines...]
> BUILD FAILED
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/build.xml:353: The following error occurred while executing this
> line:
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/build.xml:39: The following error occurred while executing this line:
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/build.xml:178: The following error occurred while executing this
> line:
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/solr/common-build.xml:438: The following error occurred while
> executing this line:
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/lucene/common-build.xml:1176: The following error occurred while
> executing this line:
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/lucene/common-build.xml:841: There were test failures: 243 suites,
> 1009 tests, 1 failure, 13 ignored (2 assumptions)
> 
> Total time: 196 minutes 6 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Description set: Java: 64bit/jdk1.6.0 -XX:+UseSerialGC
> Email was triggered for: Failure
> Sending email for trigger: Failure
> 



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build # 10 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/10/
Java: 64bit/jdk1.6.0 -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([D918F8FA64E198EA:67939E551D9B96DF]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterStateUpdateTest.java:234)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:680)




Build Log:
[...truncated 8663 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ClusterStateUpdateTest
[junit4:junit4]   2> 5 T4707 oas.SolrTestCaseJ4.setUp ###Starting testCoreRegistration
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871
[junit4:junit4]   2> 6 T4707 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 7 T4708 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 8 T4708 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 9 T4708 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 9 T4708 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 9 T4708 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 18 T4708 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 112 T4707 oasc.ZkTestServer.run start zk server on port:57629
[junit4:junit4]   2> 114 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@6ed8c84
[junit4:junit4]   2> 117 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 118 T4713 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 121 T4713 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 122 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57630
[junit4:junit4]   2> 124 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57630
[junit4:junit4]   2> 126 T4711 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 130 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d0000 with negotiated timeout 10000 for client /127.0.0.1:57630
[junit4:junit4]   2> 131 T4713 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d0000, negotiated timeout = 10000
[junit4:junit4]   2> 133 T4714 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ed8c84 name:ZooKeeperConnection Watcher:127.0.0.1:57629 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 134 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 135 T4707 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 146 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d0000
[junit4:junit4]   2> 150 T4714 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 148 T4707 oaz.ZooKeeper.close Session: 0x13be13bb93d0000 closed
[junit4:junit4]   2> 153 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57630 which had sessionid 0x13be13bb93d0000
[junit4:junit4]   2> 154 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2cd84941
[junit4:junit4]   2> 156 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 158 T4715 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 161 T4715 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 162 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57631
[junit4:junit4]   2> 163 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57631
[junit4:junit4]   2> 167 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d0001 with negotiated timeout 10000 for client /127.0.0.1:57631
[junit4:junit4]   2> 167 T4715 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d0001, negotiated timeout = 10000
[junit4:junit4]   2> 168 T4716 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2cd84941 name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 170 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 171 T4707 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 182 T4707 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 191 T4707 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 201 T4707 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 213 T4707 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 218 T4707 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 239 T4707 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 244 T4707 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 257 T4707 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 259 T4707 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 270 T4707 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 272 T4707 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 284 T4707 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 286 T4707 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 298 T4707 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 300 T4707 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 311 T4707 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 314 T4707 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 326 T4707 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 328 T4707 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 337 T4707 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 338 T4707 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 343 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d0001
[junit4:junit4]   2> 344 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57631 which had sessionid 0x13be13bb93d0001
[junit4:junit4]   2> 345 T4716 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 344 T4707 oaz.ZooKeeper.close Session: 0x13be13bb93d0001 closed
[junit4:junit4]   2> 345 T4707 oasc.ClusterStateUpdateTest.setUp ####SETUP_START testCoreRegistration
[junit4:junit4]   2> 348 T4707 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 348 T4707 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 348 T4707 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 349 T4707 oasc.CoreContainer.<init> New CoreContainer 348292905
[junit4:junit4]   2> 349 T4707 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 350 T4707 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 380 T4707 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 380 T4707 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 381 T4707 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 381 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 381 T4707 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 382 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 382 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 383 T4707 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 383 T4707 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 383 T4707 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 397 T4707 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 415 T4707 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57629/solr
[junit4:junit4]   2> 415 T4707 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 416 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2cc19747
[junit4:junit4]   2> 417 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 418 T4717 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 419 T4717 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 419 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57632
[junit4:junit4]   2> 420 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57632
[junit4:junit4]   2> 421 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d0002 with negotiated timeout 20000 for client /127.0.0.1:57632
[junit4:junit4]   2> 421 T4717 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d0002, negotiated timeout = 20000
[junit4:junit4]   2> 421 T4718 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2cc19747 name:ZooKeeperConnection Watcher:127.0.0.1:57629 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 422 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 423 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d0002
[junit4:junit4]   2> 424 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57632 which had sessionid 0x13be13bb93d0002
[junit4:junit4]   2> 424 T4718 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 424 T4707 oaz.ZooKeeper.close Session: 0x13be13bb93d0002 closed
[junit4:junit4]   2> 425 T4707 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 432 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@14abeed
[junit4:junit4]   2> 434 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 434 T4719 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 435 T4719 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 435 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57633
[junit4:junit4]   2> 436 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57633
[junit4:junit4]   2> 437 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d0003 with negotiated timeout 3000 for client /127.0.0.1:57633
[junit4:junit4]   2> 437 T4719 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d0003, negotiated timeout = 3000
[junit4:junit4]   2> 437 T4720 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14abeed name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 438 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 439 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 441 T4707 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 444 T4707 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 445 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1661_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 446 T4707 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 451 T4707 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 457 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 458 T4707 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 462 T4707 oasc.Overseer.start Overseer (id=88912264290959363-127.0.0.1:1661_solr-n_0000000000) starting
[junit4:junit4]   2> 463 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 464 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 465 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 466 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 468 T4722 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 469 T4707 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 472 T4707 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 476 T4721 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 484 T4723 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 484 T4723 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 491 T4723 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 491 T4723 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 495 T4723 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 497 T4723 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 498 T4723 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 615 T4723 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 686 T4723 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 687 T4723 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 695 T4723 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1299 T4723 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1309 T4723 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1313 T4723 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1333 T4723 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1337 T4723 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1342 T4723 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1344 T4723 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1345 T4723 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1/
[junit4:junit4]   2> 1346 T4723 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c96ad7c
[junit4:junit4]   2> 1346 T4723 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1347 T4723 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1 forceNew:false
[junit4:junit4]   2> 1347 T4723 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1
[junit4:junit4]   2> 1347 T4723 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1/index/
[junit4:junit4]   2> 1347 T4723 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1348 T4723 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1/index forceNew:false
[junit4:junit4]   2> 1349 T4723 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ff2a4cf lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c522ff4)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1349 T4723 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1349 T4723 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1/index
[junit4:junit4]   2> 1350 T4723 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1351 T4723 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1351 T4723 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1351 T4723 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1352 T4723 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1352 T4723 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1352 T4723 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1353 T4723 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1353 T4723 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1353 T4723 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1354 T4723 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1354 T4723 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1355 T4723 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1355 T4723 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1355 T4723 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1356 T4723 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1356 T4723 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1356 T4723 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1357 T4723 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1357 T4723 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1357 T4723 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1358 T4723 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1358 T4723 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1359 T4723 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1359 T4723 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1360 T4723 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1360 T4723 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1364 T4723 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1368 T4723 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1369 T4723 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1371 T4723 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1
[junit4:junit4]   2> 1372 T4723 oass.SolrIndexSearcher.<init> Opening Searcher@6fd42ccf main
[junit4:junit4]   2> 1372 T4723 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1373 T4723 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1373 T4723 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1378 T4723 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1404 T4724 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6fd42ccf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1409 T4723 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1409 T4723 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1411 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x53 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 1493 T4721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 1494 T4721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 1494 T4721 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 1495 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x5b zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 1501 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2417 T4723 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2417 T4723 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1661/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 2419 T4723 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 2440 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:delete cxid:0x78 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 2442 T4723 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2443 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x79 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2449 T4723 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2450 T4723 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2450 T4723 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 2451 T4723 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 2464 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x83 zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2521 T4721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2540 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2578 T4723 oasc.ZkController.register We are http://127.0.0.1:1661/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 2580 T4723 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 2581 T4723 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 2582 T4723 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 2591 T4723 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2597 T4707 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2598 T4707 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 2599 T4707 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 2600 T4707 oasc.CoreContainer.<init> New CoreContainer 287074249
[junit4:junit4]   2> 2602 T4707 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 2603 T4707 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 2639 T4707 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 2639 T4707 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2640 T4707 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2640 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2640 T4707 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2641 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2641 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2642 T4707 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2642 T4707 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2642 T4707 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2658 T4707 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2677 T4707 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57629/solr
[junit4:junit4]   2> 2677 T4707 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2678 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5f876e90
[junit4:junit4]   2> 2679 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2680 T4725 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2681 T4725 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 2683 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57634
[junit4:junit4]   2> 2683 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57634
[junit4:junit4]   2> 2685 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d0004 with negotiated timeout 20000 for client /127.0.0.1:57634
[junit4:junit4]   2> 2685 T4725 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d0004, negotiated timeout = 20000
[junit4:junit4]   2> 2686 T4726 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f876e90 name:ZooKeeperConnection Watcher:127.0.0.1:57629 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2686 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2687 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d0004
[junit4:junit4]   2> 2688 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57634 which had sessionid 0x13be13bb93d0004
[junit4:junit4]   2> 2689 T4707 oaz.ZooKeeper.close Session: 0x13be13bb93d0004 closed
[junit4:junit4]   2> 2691 T4707 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 2695 T4726 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2721 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@12ecb0ea
[junit4:junit4]   2> 2750 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2751 T4727 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2753 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57635
[junit4:junit4]   2> 2753 T4727 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 2754 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57635
[junit4:junit4]   2> 2755 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d0005 with negotiated timeout 3000 for client /127.0.0.1:57635
[junit4:junit4]   2> 2756 T4727 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d0005, negotiated timeout = 3000
[junit4:junit4]   2> 2756 T4728 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12ecb0ea name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2757 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2758 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0005 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2759 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0005 type:create cxid:0x2 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2761 T4707 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 2762 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0005 type:delete cxid:0x4 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1662_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 2763 T4707 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 2766 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2768 T4720 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 2777 T4707 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2789 T4729 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 2790 T4729 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2790 T4729 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2791 T4729 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2793 T4729 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 2794 T4729 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2794 T4729 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 2845 T4729 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2935 T4729 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2937 T4729 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2943 T4729 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3050 T4721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3050 T4721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 3055 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 3056 T4728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 3545 T4729 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 3553 T4729 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 3557 T4729 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3579 T4729 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3585 T4729 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3590 T4729 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3592 T4729 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3594 T4729 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2/
[junit4:junit4]   2> 3595 T4729 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c96ad7c
[junit4:junit4]   2> 3596 T4729 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 3597 T4729 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2 forceNew:false
[junit4:junit4]   2> 3597 T4729 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2
[junit4:junit4]   2> 3597 T4729 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2/index/
[junit4:junit4]   2> 3598 T4729 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3599 T4729 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2/index forceNew:false
[junit4:junit4]   2> 3600 T4729 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c23ef3c lockFactory=org.apache.lucene.store.NativeFSLockFactory@61e3666c)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3600 T4729 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3601 T4729 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2/index
[junit4:junit4]   2> 3601 T4729 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3603 T4729 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3604 T4729 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3604 T4729 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3605 T4729 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3605 T4729 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3605 T4729 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3606 T4729 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3618 T4729 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3619 T4729 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3619 T4729 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3619 T4729 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3620 T4729 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3620 T4729 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3620 T4729 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3620 T4729 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3621 T4729 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3621 T4729 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3621 T4729 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3622 T4729 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3622 T4729 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3622 T4729 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3623 T4729 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3623 T4729 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3623 T4729 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3624 T4729 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3624 T4729 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3627 T4729 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3630 T4729 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3631 T4729 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3633 T4729 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2
[junit4:junit4]   2> 3633 T4729 oass.SolrIndexSearcher.<init> Opening Searcher@54227e95 main
[junit4:junit4]   2> 3634 T4729 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3634 T4729 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3634 T4729 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3638 T4729 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3674 T4730 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54227e95 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3681 T4729 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3681 T4729 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4073 T4721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4075 T4721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1662_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1662/solr"}
[junit4:junit4]   2> 4076 T4721 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 4076 T4721 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 4088 T4728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4089 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4691 T4729 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 4691 T4729 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1662/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 4697 T4729 oasc.ZkController.register We are http://127.0.0.1:1662/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 4697 T4729 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 4698 T4729 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4698 T4729 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4700 T4729 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4702 T4707 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4702 T4707 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 4702 T4707 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 4703 T4707 oasc.CoreContainer.<init> New CoreContainer 1535165846
[junit4:junit4]   2> 4703 T4707 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 4704 T4707 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 4733 T4707 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 4733 T4707 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4734 T4707 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4734 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4734 T4707 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4735 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4735 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4736 T4707 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4736 T4707 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4737 T4707 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4751 T4707 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4768 T4707 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57629/solr
[junit4:junit4]   2> 4769 T4707 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4769 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@686b3c55
[junit4:junit4]   2> 4770 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4771 T4731 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4772 T4731 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 4772 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57636
[junit4:junit4]   2> 4773 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57636
[junit4:junit4]   2> 4774 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d0006 with negotiated timeout 20000 for client /127.0.0.1:57636
[junit4:junit4]   2> 4774 T4731 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d0006, negotiated timeout = 20000
[junit4:junit4]   2> 4775 T4732 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@686b3c55 name:ZooKeeperConnection Watcher:127.0.0.1:57629 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4775 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4777 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d0006
[junit4:junit4]   2> 4778 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57636 which had sessionid 0x13be13bb93d0006
[junit4:junit4]   2> 4778 T4707 oaz.ZooKeeper.close Session: 0x13be13bb93d0006 closed
[junit4:junit4]   2> 4778 T4732 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4778 T4707 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 4785 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@2c70bde0
[junit4:junit4]   2> 4786 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4786 T4733 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4787 T4733 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 4787 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57637
[junit4:junit4]   2> 4788 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57637
[junit4:junit4]   2> 4789 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d0007 with negotiated timeout 3000 for client /127.0.0.1:57637
[junit4:junit4]   2> 4789 T4733 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d0007, negotiated timeout = 3000
[junit4:junit4]   2> 4790 T4734 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c70bde0 name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4790 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4791 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0007 type:create cxid:0x1 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4792 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0007 type:create cxid:0x2 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4794 T4707 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 4794 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0007 type:delete cxid:0x4 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1663_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 4795 T4707 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 4798 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4798 T4728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4801 T4728 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 4802 T4720 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 4805 T4707 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4813 T4735 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 4813 T4735 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4814 T4735 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4815 T4735 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4816 T4735 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 4817 T4735 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4817 T4735 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 4862 T4735 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 4936 T4735 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4937 T4735 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4943 T4735 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5104 T4721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5105 T4721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1662_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1662/solr"}
[junit4:junit4]   2> 5110 T4734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 5111 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 5111 T4728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 5511 T4735 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5520 T4735 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5524 T4735 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5548 T4735 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5555 T4735 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5562 T4735 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5564 T4735 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5567 T4735 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/
[junit4:junit4]   2> 5567 T4735 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c96ad7c
[junit4:junit4]   2> 5568 T4735 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5568 T4735 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3 forceNew:false
[junit4:junit4]   2> 5569 T4735 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3
[junit4:junit4]   2> 5569 T4735 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index/
[junit4:junit4]   2> 5569 T4735 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5570 T4735 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index forceNew:false
[junit4:junit4]   2> 5571 T4735 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@2ba5ab4e lockFactory=org.apache.lucene.store.NativeFSLockFactory@38b7b2eb)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5572 T4735 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5572 T4735 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index
[junit4:junit4]   2> 5572 T4735 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5574 T4735 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5574 T4735 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5575 T4735 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5575 T4735 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5575 T4735 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5575 T4735 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5575 T4735 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5576 T4735 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5577 T4735 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5577 T4735 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5577 T4735 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5577 T4735 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5578 T4735 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5578 T4735 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5578 T4735 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5579 T4735 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5579 T4735 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5579 T4735 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5580 T4735 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5581 T4735 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5581 T4735 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5582 T4735 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5582 T4735 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5583 T4735 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5583 T4735 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5584 T4735 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5587 T4735 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5591 T4735 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5592 T4735 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5594 T4735 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3
[junit4:junit4]   2> 5595 T4735 oass.SolrIndexSearcher.<init> Opening Searcher@40c516f5 main
[junit4:junit4]   2> 5595 T4735 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5595 T4735 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5596 T4735 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5600 T4735 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5632 T4736 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40c516f5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5635 T4735 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5636 T4735 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6123 T4721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6126 T4721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
[junit4:junit4]   2> 6126 T4721 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 6127 T4721 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 6144 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6145 T4734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6145 T4728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6641 T4735 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6641 T4735 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1663/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 6646 T4735 oasc.ZkController.register We are http://127.0.0.1:1663/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 6646 T4735 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 6646 T4735 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6646 T4735 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6648 T4735 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6649 T4707 oasc.ClusterStateUpdateTest.setUp ####SETUP_END testCoreRegistration
[junit4:junit4]   2> 6650 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2617b1c1
[junit4:junit4]   2> 6651 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6651 T4737 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6652 T4737 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 6653 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57638
[junit4:junit4]   2> 6653 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57638
[junit4:junit4]   2> 6654 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d0008 with negotiated timeout 10000 for client /127.0.0.1:57638
[junit4:junit4]   2> 6654 T4737 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d0008, negotiated timeout = 10000
[junit4:junit4]   2> 6655 T4738 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2617b1c1 name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6655 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6656 T4707 oascc.SolrZkClient.makePath makePath: /collections/testcore
[junit4:junit4]   2> 6662 T4721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6663 T4721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
[junit4:junit4]   2> 6664 T4707 oascc.SolrZkClient.makePath makePath: /collections/testcore/shards
[junit4:junit4]   2> 6670 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6671 T4728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6670 T4734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6671 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d0008
[junit4:junit4]   2> 6673 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57638 which had sessionid 0x13be13bb93d0008
[junit4:junit4]   2> 6673 T4707 oaz.ZooKeeper.close Session: 0x13be13bb93d0008 closed
[junit4:junit4]   2> 6674 T4707 oasc.CoreContainer.create Creating SolrCore 'testcore' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore
[junit4:junit4]   2> 6675 T4738 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6675 T4707 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testcore
[junit4:junit4]   2> 6677 T4707 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6677 T4707 oasc.ZkController.readConfigName Load collection config from:/collections/testcore
[junit4:junit4]   2> 6680 T4707 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore/'
[junit4:junit4]   2> 6744 T4707 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 6807 T4707 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6809 T4707 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6815 T4707 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 7459 T4707 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7467 T4707 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7470 T4707 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7492 T4707 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7497 T4707 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7502 T4707 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7504 T4707 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7506 T4707 oasc.SolrCore.<init> [testcore] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4/
[junit4:junit4]   2> 7506 T4707 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c96ad7c
[junit4:junit4]   2> 7507 T4707 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 7507 T4707 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4 forceNew:false
[junit4:junit4]   2> 7508 T4707 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4
[junit4:junit4]   2> 7508 T4707 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4/index/
[junit4:junit4]   2> 7508 T4707 oasc.SolrCore.initIndex WARNING [testcore] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7509 T4707 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4/index forceNew:false
[junit4:junit4]   2> 7510 T4707 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fbe0d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65102f8b)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7511 T4707 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 7511 T4707 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4/index
[junit4:junit4]   2> 7512 T4707 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7513 T4707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7514 T4707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7514 T4707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7514 T4707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7514 T4707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7515 T4707 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7515 T4707 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7515 T4707 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7517 T4707 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7517 T4707 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7517 T4707 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7518 T4707 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7518 T4707 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7518 T4707 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7519 T4707 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7519 T4707 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7519 T4707 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7520 T4707 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7521 T4707 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7522 T4707 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7522 T4707 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7523 T4707 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7523 T4707 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7524 T4707 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7525 T4707 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7525 T4707 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7531 T4707 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7535 T4707 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7536 T4707 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7539 T4707 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4
[junit4:junit4]   2> 7540 T4707 oass.SolrIndexSearcher.<init> Opening Searcher@72b6e11e main
[junit4:junit4]   2> 7541 T4707 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7541 T4707 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7542 T4707 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7548 T4707 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7575 T4739 oasc.SolrCore.registerSearcher [testcore] Registered new searcher Searcher@72b6e11e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7581 T4707 oasc.ZkController.publish publishing core=testcore state=down
[junit4:junit4]   2> 7582 T4707 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7706 T4721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7708 T4721 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 7709 T4721 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 7724 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7724 T4728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7724 T4734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8592 T4707 oasc.CoreContainer.registerCore registering core: testcore
[junit4:junit4]   2> 8593 T4707 oasc.ZkController.register Register replica - core:testcore address:http://127.0.0.1:1661/solr collection:testcore shard:shard1
[junit4:junit4]   2> 8597 T4707 oascc.SolrZkClient.makePath makePath: /collections/testcore/leader_elect/shard1/election
[junit4:junit4]   2> 8626 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:delete cxid:0x14d zxid:0x7c txntype:-1 reqpath:n/a Error Path:/solr/collections/testcore/leaders Error:KeeperErrorCode = NoNode for /solr/collections/testcore/leaders
[junit4:junit4]   2> 8628 T4707 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 8632 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x14e zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8640 T4707 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 8641 T4707 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 8641 T4707 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:1661/solr/testcore/
[junit4:junit4]   2> 8642 T4707 oascc.SolrZkClient.makePath makePath: /collections/testcore/leaders/shard1
[junit4:junit4]   2> 8658 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d0003 type:create cxid:0x158 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8747 T4721 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8776 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8777 T4734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8778 T4728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8822 T4707 oasc.ZkController.register We are http://127.0.0.1:1661/solr/testcore/ and leader is http://127.0.0.1:1661/solr/testcore/
[junit4:junit4]   2> 8823 T4707 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 8824 T4707 oasc.ZkController.publish publishing core=testcore state=active
[junit4:junit4]   2> 8825 T4707 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8831 T4707 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8834 T4707 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1535165846
[junit4:junit4]   2> 8835 T4707 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4c3c6254
[junit4:junit4]   2> 8844 T4707 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 8845 T4707 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 8845 T4707 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 8845 T4707 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 8846 T4707 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 8847 T4707 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index
[junit4:junit4]   2> 8847 T4707 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index
[junit4:junit4]   2> 8848 T4707 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index
[junit4:junit4]   2> 8848 T4707 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3
[junit4:junit4]   2> 8849 T4707 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3
[junit4:junit4]   2> 8850 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d0007
[junit4:junit4]   2> 8851 T4720 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8851 T4734 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8851 T4734 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 8851 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57637 which had sessionid 0x13be13bb93d0007
[junit4:junit4]   2> 8851 T4707 oaz.ZooKeeper.close Session: 0x13be13bb93d0007 closed
[junit4:junit4]   2> 8851 T4728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8852 T4734 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 8852 T4734 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8858 T4720 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 8859 T4728 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 9056 T4728 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9057 T4709 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13be13bb93d0005, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 9056 T4707 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=287074249
[junit4:junit4]   2> 9058 T4707 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@272c9b42
[junit4:junit4]   2> 9059 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57635 which had sessionid 0x13be13bb93d0005
[junit4:junit4]   2> 9062 T4707 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 9063 T4707 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 9063 T4707 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 9064 T4707 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 9064 T4707 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 9066 T4707 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2/index
[junit4:junit4]   2> 9067 T4707 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2/index
[junit4:junit4]   2> 9067 T4707 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2/index
[junit4:junit4]   2> 9069 T4707 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2
[junit4:junit4]   2> 9069 T4707 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data2
[junit4:junit4]   2> 9071 T4707 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9071 T4707 oasc.SolrResourceLoader.locateSolrHome solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4:junit4]   2> 9072 T4707 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/solr/solr.xml
[junit4:junit4]   2> 9072 T4707 oasc.CoreContainer.<init> New CoreContainer 1050006525
[junit4:junit4]   2> 9073 T4707 oasc.CoreContainer$Initializer.initialize no solr.xml file found - using default
[junit4:junit4]   2> 9074 T4707 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'solr/'
[junit4:junit4]   2> 9075 T4707 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'solr/'
[junit4:junit4]   2> 9117 T4707 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 9117 T4707 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9118 T4707 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 9118 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9119 T4707 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9119 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9119 T4707 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9120 T4707 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9120 T4707 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9120 T4707 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 9135 T4707 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9151 T4707 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:57629/solr
[junit4:junit4]   2> 9152 T4707 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 9152 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6acd5cfc
[junit4:junit4]   2> 9153 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9153 T4740 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 9154 T4740 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 9155 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57639
[junit4:junit4]   2> 9155 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57639
[junit4:junit4]   2> 9156 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d0009 with negotiated timeout 20000 for client /127.0.0.1:57639
[junit4:junit4]   2> 9156 T4740 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d0009, negotiated timeout = 20000
[junit4:junit4]   2> 9156 T4741 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6acd5cfc name:ZooKeeperConnection Watcher:127.0.0.1:57629 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9157 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9158 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d0009
[junit4:junit4]   2> 9159 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57639 which had sessionid 0x13be13bb93d0009
[junit4:junit4]   2> 9159 T4707 oaz.ZooKeeper.close Session: 0x13be13bb93d0009 closed
[junit4:junit4]   2> 9160 T4741 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9160 T4707 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=0&connTimeout=0
[junit4:junit4]   2> 12135 T4710 oazs.ZooKeeperServer.expire Expiring session 0x13be13bb93d0005, timeout of 3000ms exceeded
[junit4:junit4]   2> 14313 T4707 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@5b927dbb
[junit4:junit4]   2> 14314 T4719 oaz.ClientCnxn$SendThread.run Client session timed out, have not heard from server in 5455ms for sessionid 0x13be13bb93d0003, closing socket connection and attempting reconnect
[junit4:junit4]   2> 14314 T4710 oazs.ZooKeeperServer.expire Expiring session 0x13be13bb93d0003, timeout of 3000ms exceeded
[junit4:junit4]   2> 14315 T4709 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13be13bb93d0003, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 14315 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d0005
[junit4:junit4]   2> 14315 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d0003
[junit4:junit4]   2> 14315 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57633 which had sessionid 0x13be13bb93d0003
[junit4:junit4]   2> 14316 T4742 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 14316 T4707 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 14317 T4742 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 14318 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57640
[junit4:junit4]   2> 14318 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57640
[junit4:junit4]   2> 14319 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d000a with negotiated timeout 3000 for client /127.0.0.1:57640
[junit4:junit4]   2> 14319 T4742 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d000a, negotiated timeout = 3000
[junit4:junit4]   2> 14319 T4743 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b927dbb name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 14319 T4707 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 14320 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:create cxid:0x1 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14321 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:create cxid:0x2 zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14323 T4707 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 14324 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:delete cxid:0x4 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/192.168.57.17:8983_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 14325 T4707 oascc.SolrZkClient.makePath makePath: /live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 14332 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:delete cxid:0xd zxid:0x96 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 14333 T4707 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 14337 T4707 oasc.Overseer.start Overseer (id=88912264290959370-192.168.57.17:8983_solr-n_0000000003) starting
[junit4:junit4]   2> 14338 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:create cxid:0x12 zxid:0x98 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14339 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:create cxid:0x13 zxid:0x99 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14340 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:create cxid:0x14 zxid:0x9a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14342 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:create cxid:0x15 zxid:0x9b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 14343 T4745 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 14344 T4707 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 14347 T4744 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 14349 T4744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14350 T4744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 14352 T4746 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: solr/collection1
[junit4:junit4]   2> 14352 T4746 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 14353 T4746 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 14354 T4746 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 14354 T4743 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 14356 T4746 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'solr/collection1/'
[junit4:junit4]   2> 14398 T4746 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 14415 T4720 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14abeed name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 14416 T4720 oascc.ConnectionManager.process zkClient has disconnected
[junit4:junit4]   2> 14416 T4720 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Disconnected type None
[junit4:junit4]   2> 14476 T4746 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 14478 T4746 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 14485 T4746 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 15076 T4746 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 15086 T4746 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 15091 T4746 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 15112 T4746 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15118 T4746 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 15136 T4746 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15138 T4746 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 15140 T4746 oasc.SolrCore.<init> [collection1] Opening new SolrCore at solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/
[junit4:junit4]   2> 15141 T4746 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c96ad7c
[junit4:junit4]   2> 15141 T4746 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 15142 T4746 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3 forceNew:false
[junit4:junit4]   2> 15142 T4746 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3
[junit4:junit4]   2> 15143 T4746 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index/
[junit4:junit4]   2> 15143 T4746 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 15144 T4746 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index forceNew:false
[junit4:junit4]   2> 15145 T4746 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@69e8ab02 lockFactory=org.apache.lucene.store.NativeFSLockFactory@c61c805)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15145 T4746 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15146 T4746 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index
[junit4:junit4]   2> 15146 T4746 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 15148 T4746 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 15149 T4746 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 15149 T4746 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 15149 T4746 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 15150 T4746 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 15150 T4746 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 15151 T4746 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 15151 T4746 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 15152 T4746 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 15152 T4746 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 15152 T4746 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 15153 T4746 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 15153 T4746 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 15154 T4746 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 15154 T4746 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 15154 T4746 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 15155 T4746 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15155 T4746 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15157 T4746 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15157 T4746 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15158 T4746 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15158 T4746 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15158 T4746 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15159 T4746 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 15159 T4746 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 15160 T4746 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 15163 T4746 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 15165 T4746 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 15167 T4746 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 15168 T4746 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3
[junit4:junit4]   2> 15169 T4746 oass.SolrIndexSearcher.<init> Opening Searcher@17c62813 main
[junit4:junit4]   2> 15170 T4746 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 15170 T4746 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 15170 T4746 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 15172 T4746 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 15186 T4747 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17c62813 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 15188 T4746 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 15188 T4746 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15376 T4744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15377 T4744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"192.168.57.17:8983_solr",
[junit4:junit4]   2> 	  "base_url":"http://192.168.57.17:8983/solr"}
[junit4:junit4]   2> 15377 T4744 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 15378 T4744 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 15385 T4743 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 16030 T4719 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 16032 T4719 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 16034 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57641
[junit4:junit4]   2> 16036 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to renew session 0x13be13bb93d0003 at /127.0.0.1:57641
[junit4:junit4]   2> 16037 T4709 oazs.ZooKeeperServer.finishSessionInit Invalid session 0x13be13bb93d0003 for client /127.0.0.1:57641, probably expired
[junit4:junit4]   2> 16038 T4720 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14abeed name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4:junit4]   2> 16039 T4720 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4:junit4]   2> 16037 T4719 oaz.ClientCnxn$SendThread.run Unable to reconnect to ZooKeeper service, session 0x13be13bb93d0003 has expired, closing socket connection
[junit4:junit4]   2> 16039 T4720 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4:junit4]   2> 16038 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57641 which had sessionid 0x13be13bb93d0003
[junit4:junit4]   2> 16041 T4720 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:57629/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@14abeed
[junit4:junit4]   2> 16043 T4720 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16044 T4748 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:57629. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 16048 T4748 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:57629, initiating session
[junit4:junit4]   2> 16048 T4709 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:57642
[junit4:junit4]   2> 16049 T4709 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:57642
[junit4:junit4]   2> 16053 T4748 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:57629, sessionid = 0x13be13bb93d000b, negotiated timeout = 3000
[junit4:junit4]   2> 16052 T4711 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be13bb93d000b with negotiated timeout 3000 for client /127.0.0.1:57642
[junit4:junit4]   2> 16053 T4749 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14abeed name:ZooKeeperConnection Watcher:127.0.0.1:57629/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16055 T4720 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16055 T4720 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4:junit4]   2> 16056 T4720 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 16056 T4720 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 16155 T4721 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:200)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:123)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 16155 T4722 oasc.OverseerCollectionProcessor.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 16157 T4721 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88912264290959363-127.0.0.1:1661_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 16191 T4746 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 16191 T4746 oasc.ZkController.register Register replica - core:collection1 address:http://192.168.57.17:8983/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 16199 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:delete cxid:0x6c zxid:0xa8 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 16202 T4746 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 16204 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:create cxid:0x6d zxid:0xa9 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16210 T4746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=179999
[junit4:junit4]   2> 16403 T4744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16404 T4744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 16418 T4743 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 36337 T4746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=159872
[junit4:junit4]   2> 46149 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 56462 T4746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=139747
[junit4:junit4]   2> 76613 T4746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=119596
[junit4:junit4]   2> 78242 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 96710 T4746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=99499
[junit4:junit4]   2> 110340 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 116820 T4746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=79389
[junit4:junit4]   2> 136933 T4746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=59276
[junit4:junit4]   2> 142416 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 157042 T4746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=39167
[junit4:junit4]   2> 174502 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 177180 T4746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=19029
[junit4:junit4]   2> 196281 T4746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Was waiting for replicas to come up, but they are taking too long - assuming they won't come back till later
[junit4:junit4]   2> 196282 T4746 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 196283 T4746 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://192.168.57.17:8983/solr/collection1/
[junit4:junit4]   2> 196284 T4746 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 196296 T4712 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be13bb93d000a type:create cxid:0x622 zxid:0xb3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 196555 T4720 oasc.ZkController.publish publishing core=testcore state=down
[junit4:junit4]   2> 196555 T4720 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 196685 T4744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 196692 T4744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 196699 T4743 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 196735 T4746 oasc.ZkController.register We are http://192.168.57.17:8983/solr/collection1/ and leader is http://192.168.57.17:8983/solr/collection1/
[junit4:junit4]   2> 196735 T4746 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 196736 T4746 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 196736 T4746 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 196739 T4746 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 197211 T4744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 197212 T4744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"192.168.57.17:8983_solr",
[junit4:junit4]   2> 	  "base_url":"http://192.168.57.17:8983/solr"}
[junit4:junit4]   2> 197219 T4743 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 217055 T4707 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=348292905
[junit4:junit4]   2> 217056 T4707 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@36b3a26b
[junit4:junit4]   2> 217062 T4707 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 217063 T4707 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 217063 T4707 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 217064 T4707 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 217065 T4707 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 217066 T4707 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1/index
[junit4:junit4]   2> 217066 T4707 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1
[junit4:junit4]   2> 217067 T4707 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1
[junit4:junit4]   2> 217067 T4707 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1/index
[junit4:junit4]   2> 217068 T4707 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data1/index
[junit4:junit4]   2> 217068 T4707 oasc.SolrCore.close [testcore]  CLOSING SolrCore org.apache.solr.core.SolrCore@1c39197c
[junit4:junit4]   2> 217078 T4707 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 217079 T4707 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 217079 T4707 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 217080 T4707 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 217080 T4707 oasc.SolrCore.closeSearcher [testcore] Closing main searcher on request.
[junit4:junit4]   2> 217081 T4707 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4/index
[junit4:junit4]   2> 217081 T4707 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4/index
[junit4:junit4]   2> 217082 T4707 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4/index
[junit4:junit4]   2> 217082 T4707 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4
[junit4:junit4]   2> 217083 T4707 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data4
[junit4:junit4]   2> 217084 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d000b
[junit4:junit4]   2> 217085 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57642 which had sessionid 0x13be13bb93d000b
[junit4:junit4]   2> 217085 T4707 oaz.ZooKeeper.close Session: 0x13be13bb93d000b closed
[junit4:junit4]   2> 217085 T4749 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 217086 T4707 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1050006525
[junit4:junit4]   2> 217086 T4707 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6d346c33
[junit4:junit4]   2> 217097 T4707 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 217098 T4707 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 217098 T4707 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 217099 T4707 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 217099 T4707 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 217100 T4707 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index
[junit4:junit4]   2> 217101 T4707 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3
[junit4:junit4]   2> 217101 T4707 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3
[junit4:junit4]   2> 217102 T4707 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index
[junit4:junit4]   2> 217102 T4707 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356693485871/data3/index
[junit4:junit4]   2> 217106 T4744 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88912264290959370-192.168.57.17:8983_solr-n_0000000003) am no longer a leader.
[junit4:junit4]   2> 217107 T4712 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be13bb93d000a
[junit4:junit4]   2> 217110 T4709 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57640 which had sessionid 0x13be13bb93d000a
[junit4:junit4]   2> 217110 T4707 oaz.ZooKeeper.close Session: 0x13be13bb93d000a closed
[junit4:junit4]   2> 217111 T4707 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1535165846
[junit4:junit4]   2> 217111 T4707 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 217112 T4707 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 217112 T4707 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 217113 T4712 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 217113 T4707 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 217118 T4711 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 217119 T4707 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 217135 T4710 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 217228 T4707 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:57629 57629
[junit4:junit4]   2> 217324 T4709 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 217326 T4707 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 217327 T4707 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 217327 T4707 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 217327 T4707 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 217327 T4707 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 217328 T4707 oas.SolrTestCaseJ4.tearDown ###Ending testCoreRegistration
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ClusterStateUpdateTest -Dtests.method=testCoreRegistration -Dtests.seed=D918F8FA64E198EA -Dtests.slow=true -Dtests.locale=fr_CH -Dtests.timezone=America/Cancun -Dtests.file.encoding=MacRoman
[junit4:junit4] FAILURE  217s | ClusterStateUpdateTest.testCoreRegistration <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([D918F8FA64E198EA:67939E551D9B96DF]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:92)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:54)
[junit4:junit4]    > 	at org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterStateUpdateTest.java:234)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 217338 T4707 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 217392 T4706 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> 217612 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 218411 T4743 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 218412 T4743 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 218412 T4743 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 218412 T4743 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 220615 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 223618 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 226621 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 229628 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 232637 T4720 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 234641 T4720 oasc.SolrException.log SEVERE :org.apache.solr.common.SolrException: There was a problem finding the leader in zk
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1179)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 234642 T4720 oasc.SolrException.log SEVERE :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election/88912264290959371-127.0.0.1:1661_solr-n_
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:293)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:220)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:197)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 234643 T4720 oasc.SolrException.log SEVERE Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException: 
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:225)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election/88912264290959371-127.0.0.1:1661_solr-n_
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:293)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:220)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:197)
[junit4:junit4]   2> 		... 5 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 234644 T4720 oascc.DefaultConnectionStrategy.reconnect Reconnect to ZooKeeper failed
[junit4:junit4]   2> 234644 T4720 oascc.ConnectionManager.process Connected:true
[junit4:junit4]   2> 234645 T4720 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Expired type None
[junit4:junit4]   2> 234645 T4720 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=fr_CH, timezone=America/Cancun
[junit4:junit4]   2> NOTE: Mac OS X 10.8.2 x86_64/Apple Inc. 1.6.0_37 (64-bit)/cpus=2,threads=1,free=131498952,total=276488192
[junit4:junit4]   2> NOTE: All tests run in this JVM: [IndexReaderFactoryTest, ConvertedLegacyTest, SpellCheckCollatorTest, LeaderElectionIntegrationTest, SpellingQueryConverterTest, TermVectorComponentDistributedTest, TestRealTimeGet, QueryEqualityTest, TestStressReorder, TestConfig, ZkNodePropsTest, CacheHeaderTest, SolrInfoMBeanTest, SolrRequestParserTest, SyncSliceTest, TestSolrQueryParser, TimeZoneUtilsTest, ScriptEngineTest, ExternalFileFieldSortTest, ReturnFieldsTest, TestFoldingMultitermQuery, PeerSyncTest, TestRTGBase, TestExtendedDismaxParser, CurrencyFieldTest, ZkCLITest, FullSolrCloudDistribCmdsTest, URLClassifyProcessorTest, DirectSolrConnectionTest, ZkSolrClientTest, BasicFunctionalityTest, TestQueryTypes, TestQuerySenderNoQuery, TestWriterPerf, TestPropInjectDefaults, TestPerFieldSimilarity, RequiredFieldsTest, OverseerTest, TestUpdate, TestLFUCache, TestSort, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestSystemIdResolver, TestStressRecovery, TestJmxMonitoredMap, TermVectorComponentTest, MBeansHandlerTest, IndexBasedSpellCheckerTest, TestQuerySenderListener, BinaryUpdateRequestHandlerTest, TestDocumentBuilder, SuggesterFSTTest, LukeRequestHandlerTest, TestStressVersions, SuggesterWFSTTest, JsonLoaderTest, PathHierarchyTokenizerFactoryTest, SolrCoreCheckLockOnStartupTest, SystemInfoHandlerTest, TestRecovery, PluginInfoTest, SolrCmdDistributorTest, WordBreakSolrSpellCheckerTest, TestCoreContainer, TestCSVLoader, TestQueryUtils, BadComponentTest, DocumentAnalysisRequestHandlerTest, TestReload, MultiTermTest, FastVectorHighlighterTest, TestNumberUtils, TestPseudoReturnFields, TestFastWriter, TestFuzzyAnalyzedSuggestions, TestAnalyzedSuggestions, DebugComponentTest, PolyFieldTest, TestOmitPositions, SimpleFacetsTest, TestBinaryResponseWriter, DirectSolrSpellCheckerTest, JSONWriterTest, TestPHPSerializedResponseWriter, TestReversedWildcardFilterFactory, TestPhraseSuggestions, DateMathParserTest, OutputWriterTest, TestSearchPerf, TestCSVResponseWriter, TestMergePolicyConfig, TestUtils, TestIndexingPerformance, TestCharFilters, DistributedTermsComponentTest, TestFunctionQuery, TestValueSourceCache, AlternateDirectoryTest, XmlUpdateRequestHandlerTest, UpdateRequestProcessorFactoryTest, BadIndexSchemaTest, DateFieldTest, TestDefaultSimilarityFactory, MoreLikeThisHandlerTest, TestDistributedSearch, StatsComponentTest, SuggesterTSTTest, SuggesterTest, FileBasedSpellCheckerTest, ShardRoutingCustomTest, HighlighterConfigTest, TestSolrXMLSerializer, OverseerCollectionProcessorTest, CopyFieldTest, CollectionsAPIDistributedZkTest, BasicDistributedZkTest, RecoveryZkTest, SpellCheckComponentTest, TestReplicationHandler, LeaderElectionTest, DistributedSpellCheckComponentTest, ZkControllerTest, TestDistributedGrouping, TestRandomFaceting, SoftAutoCommitTest, AutoCommitTest, BasicZkTest, TestFaceting, TestHashPartitioner, TestJoin, SolrCoreTest, TestRangeQuery, DirectUpdateHandlerTest, TestMultiCoreConfBootstrap, TestGroupingSearch, TestFiltering, QueryElevationComponentTest, SortByFunctionTest, SignatureUpdateProcessorFactoryTest, TestJmxIntegration, SampleTest, HighlighterTest, TestIndexSearcher, CoreAdminHandlerTest, TestTrie, TestRemoteStreaming, TestWordDelimiterFilterFactory, SpatialFilterTest, DocumentBuilderTest, DistributedQueryElevationComponentTest, DisMaxRequestHandlerTest, IndexSchemaTest, QueryParsingTest, TermsComponentTest, DistanceFunctionTest, XsltUpdateRequestHandlerTest, MinimalSchemaTest, StandardRequestHandlerTest, FieldAnalysisRequestHandlerTest, PingRequestHandlerTest, TestSurroundQueryParser, DirectUpdateHandlerOptimizeTest, IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, RequestHandlersTest, SearchHandlerTest, TestArbitraryIndexDir, LoggingHandlerTest, UniqFieldsUpdateProcessorFactoryTest, UpdateParamsTest, CSVRequestHandlerTest, ShowFileRequestHandlerTest, NotRequiredUniqueKeyTest, TestSolrDeletionPolicy1, TestLuceneMatchVersion, TestPropInject, NoCacheHeaderTest, PrimitiveFieldTypeTest, FieldMutatingUpdateProcessorTest, TestBinaryField, TestSolrDeletionPolicy2, SOLR749Test, DefaultValueUpdateProcessorTest, TestXIncludeConfig, TestDocSet, TestCollationField, SolrIndexConfigTest, NumericFieldsTest, TestSolrCoreProperties, EchoParamsTest, SpellPossibilityIteratorTest, TestBM25SimilarityFactory, TestPluginEnable, LegacyHTMLStripCharFilterTest, TestLMJelinekMercerSimilarityFactory, TestDFRSimilarityFactory, TestCodecSupport, TestFastLRUCache, PrimUtilsTest, OpenExchangeRatesOrgProviderTest, ResourceLoaderTest, FileUtilsTest, TestSuggestSpellingConverter, TestBadConfig, DOMUtilTest, TestLRUCache, ChaosMonkeySafeLeaderTest, UUIDFieldTest, RAMDirectoryFactoryTest, PreAnalyzedFieldTest, CircularListTest, AnalysisAfterCoreReloadTest, BasicDistributedZk2Test, ClusterStateTest, ClusterStateUpdateTest]
[junit4:junit4] Completed in 234.89s, 1 test, 1 failure <<< FAILURES!

[...truncated 56 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:353: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:178: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:438: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1176: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:841: There were test failures: 243 suites, 1009 tests, 1 failure, 13 ignored (2 assumptions)

Total time: 196 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.6.0 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 9 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/9/
Java: 64bit/jdk1.7.0 -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 230 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
	at __randomizedtesting.SeedInfo.seed([B78E2D935646536A:3668A38B21193356]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:175)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:125)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:120)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCoreUnloadAndLeaders(BasicDistributedZkTest.java:586)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:337)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8631 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 1 T16 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 45 T16 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1356680118984
[junit4:junit4]   2> 58 T16 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 79 T17 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 183 T17 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 183 T17 oaz.Environment.logEnv Server environment:host.name=localhost
[junit4:junit4]   2> 184 T17 oaz.Environment.logEnv Server environment:java.version=1.7.0_10
[junit4:junit4]   2> 184 T17 oaz.Environment.logEnv Server environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 185 T17 oaz.Environment.logEnv Server environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.7.0_10.jdk/Contents/Home/jre
[junit4:junit4]   2> 186 T17 oaz.Environment.logEnv Server environment:java.class.path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/classes/test:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-test-framework/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/test-framework/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/codecs/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-solrj/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/cglib-nodep-2.2.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-cli-1.2.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-codec-1.7.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-fileupload-1.2.1.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-lang-2.6.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/easymock-3.0.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/guava-13.0.1.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/javax.servlet-api-3.0.1.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/objenesis-1.2.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/spatial4j-0.3.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/commons-io-2.1.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/httpclient-4.1.3.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/httpcore-4.1.4.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/httpmime-4.1.3.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/slf4j-api-1.6.4.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/wstx-asl-3.2.7.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/zookeeper-3.4.5.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/servlet-api-3.0.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/core/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/test-framework/lib/junit-4.10.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/test-framework/lib/randomizedtesting-runner-2.0.7.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/Users/jenkins/.ant/lib/ivy-2.2.0.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_10.jdk/Contents/Home/lib/tools.jar:/Users/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.7.jar
[junit4:junit4]   2> 188 T17 oaz.Environment.logEnv Server environment:java.library.path=/Users/jenkins/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
[junit4:junit4]   2> 189 T17 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4]   2> 189 T17 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4]   2> 190 T17 oaz.Environment.logEnv Server environment:os.name=Mac OS X
[junit4:junit4]   2> 190 T17 oaz.Environment.logEnv Server environment:os.arch=x86_64
[junit4:junit4]   2> 191 T17 oaz.Environment.logEnv Server environment:os.version=10.8.2
[junit4:junit4]   2> 193 T17 oaz.Environment.logEnv Server environment:user.name=jenkins
[junit4:junit4]   2> 193 T17 oaz.Environment.logEnv Server environment:user.home=/Users/jenkins
[junit4:junit4]   2> 194 T17 oaz.Environment.logEnv Server environment:user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 253 T17 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 255 T17 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 256 T17 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 280 T17 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 358 T17 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 381 T16 oasc.ZkTestServer.run start zk server on port:54242
[junit4:junit4]   2> 477 T16 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4]   2> 484 T16 oaz.Environment.logEnv Client environment:host.name=localhost
[junit4:junit4]   2> 485 T16 oaz.Environment.logEnv Client environment:java.version=1.7.0_10
[junit4:junit4]   2> 486 T16 oaz.Environment.logEnv Client environment:java.vendor=Oracle Corporation
[junit4:junit4]   2> 487 T16 oaz.Environment.logEnv Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.7.0_10.jdk/Contents/Home/jre
[junit4:junit4]   2> 489 T16 oaz.Environment.logEnv Client environment:java.class.path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/classes/test:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-test-framework/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/test-framework/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/codecs/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-solrj/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/cglib-nodep-2.2.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-cli-1.2.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-codec-1.7.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-fileupload-1.2.1.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/commons-lang-2.6.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/easymock-3.0.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/guava-13.0.1.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/javax.servlet-api-3.0.1.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/objenesis-1.2.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/core/lib/spatial4j-0.3.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/commons-io-2.1.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/httpclient-4.1.3.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/httpcore-4.1.4.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/httpmime-4.1.3.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/log4j-over-slf4j-1.6.4.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/slf4j-api-1.6.4.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/wstx-asl-3.2.7.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/solrj/lib/zookeeper-3.4.5.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/lib/servlet-api-3.0.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build/core/classes/java:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/test-framework/lib/junit-4.10.jar:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/test-framework/lib/randomizedtesting-runner-2.0.7.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-launcher.jar:/Users/jenkins/.ant/lib/ivy-2.2.0.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-antlr.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bcel.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-bsf.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-log4j.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-oro.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-regexp.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-resolver.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-apache-xalan2.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-logging.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-commons-net.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jai.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-javamail.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jdepend.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jmf.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-jsch.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-junit4.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-netrexx.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-swing.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant-testutil.jar:/Users/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2/lib/ant.jar:/Library/Java/JavaVirtualMachines/jdk1.7.0_10.jdk/Contents/Home/lib/tools.jar:/Users/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.7.jar
[junit4:junit4]   2> 492 T16 oaz.Environment.logEnv Client environment:java.library.path=/Users/jenkins/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
[junit4:junit4]   2> 493 T16 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4]   2> 494 T16 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4]   2> 496 T16 oaz.Environment.logEnv Client environment:os.name=Mac OS X
[junit4:junit4]   2> 498 T16 oaz.Environment.logEnv Client environment:os.arch=x86_64
[junit4:junit4]   2> 500 T16 oaz.Environment.logEnv Client environment:os.version=10.8.2
[junit4:junit4]   2> 502 T16 oaz.Environment.logEnv Client environment:user.name=jenkins
[junit4:junit4]   2> 504 T16 oaz.Environment.logEnv Client environment:user.home=/Users/jenkins
[junit4:junit4]   2> 506 T16 oaz.Environment.logEnv Client environment:user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 512 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@32c9f86a
[junit4:junit4]   2> 610 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 625 T22 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 632 T22 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 826 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54243
[junit4:junit4]   2> 848 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54243
[junit4:junit4]   2> 858 T20 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 885 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc4220000 with negotiated timeout 10000 for client /127.0.0.1:54243
[junit4:junit4]   2> 887 T22 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc4220000, negotiated timeout = 10000
[junit4:junit4]   2> 895 T23 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32c9f86a name:ZooKeeperConnection Watcher:127.0.0.1:54242 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 897 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 908 T16 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 962 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be06fc4220000
[junit4:junit4]   2> 965 T23 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 966 T16 oaz.ZooKeeper.close Session: 0x13be06fc4220000 closed
[junit4:junit4]   2> 966 T18 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54243 which had sessionid 0x13be06fc4220000
[junit4:junit4]   2> 969 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@526cbc89
[junit4:junit4]   2> 971 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 972 T24 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 975 T24 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 975 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54244
[junit4:junit4]   2> 978 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54244
[junit4:junit4]   2> 981 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc4220001 with negotiated timeout 10000 for client /127.0.0.1:54244
[junit4:junit4]   2> 981 T24 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc4220001, negotiated timeout = 10000
[junit4:junit4]   2> 982 T25 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@526cbc89 name:ZooKeeperConnection Watcher:127.0.0.1:54242/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 983 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 987 T16 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 998 T16 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 1009 T16 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 1017 T16 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 1028 T16 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 1050 T16 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 1075 T16 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 1076 T16 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 1085 T16 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 1086 T16 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 1094 T16 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 1096 T16 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 1104 T16 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 1105 T16 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 1117 T16 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 1119 T16 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 1129 T16 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 1131 T16 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 1142 T16 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 1144 T16 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 1155 T16 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 1156 T16 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 1167 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be06fc4220001
[junit4:junit4]   2> 1169 T16 oaz.ZooKeeper.close Session: 0x13be06fc4220001 closed
[junit4:junit4]   2> 1169 T25 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1169 T18 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54244 which had sessionid 0x13be06fc4220001
[junit4:junit4]   2> 1800 T16 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 2047 T16 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54245
[junit4:junit4]   2> 2091 T16 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2093 T16 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108
[junit4:junit4]   2> 2095 T16 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108/'
[junit4:junit4]   2> 2174 T16 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 2175 T16 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 2176 T16 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108
[junit4:junit4]   2> 2177 T16 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108/solr.xml
[junit4:junit4]   2> 2178 T16 oasc.CoreContainer.<init> New CoreContainer 715986777
[junit4:junit4]   2> 2179 T16 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108/'
[junit4:junit4]   2> 2180 T16 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108/'
[junit4:junit4]   2> 2243 T16 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 2244 T16 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2246 T16 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2247 T16 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2247 T16 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2248 T16 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2253 T16 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2255 T16 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2255 T16 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2285 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2934 T16 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3019 T16 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54242/solr
[junit4:junit4]   2> 3049 T16 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3051 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3456ad30
[junit4:junit4]   2> 3054 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3057 T36 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3065 T36 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 3065 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54246
[junit4:junit4]   2> 3069 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54246
[junit4:junit4]   2> 3074 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc4220002 with negotiated timeout 20000 for client /127.0.0.1:54246
[junit4:junit4]   2> 3074 T36 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc4220002, negotiated timeout = 20000
[junit4:junit4]   2> 3076 T37 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3456ad30 name:ZooKeeperConnection Watcher:127.0.0.1:54242 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3078 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3083 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be06fc4220002
[junit4:junit4]   2> 3086 T18 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54246 which had sessionid 0x13be06fc4220002
[junit4:junit4]   2> 3087 T37 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3087 T16 oaz.ZooKeeper.close Session: 0x13be06fc4220002 closed
[junit4:junit4]   2> 3094 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 3118 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3374dc2d
[junit4:junit4]   2> 3121 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3122 T38 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3125 T38 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 3126 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54247
[junit4:junit4]   2> 3129 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54247
[junit4:junit4]   2> 3132 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc4220003 with negotiated timeout 20000 for client /127.0.0.1:54247
[junit4:junit4]   2> 3132 T38 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc4220003, negotiated timeout = 20000
[junit4:junit4]   2> 3134 T39 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3374dc2d name:ZooKeeperConnection Watcher:127.0.0.1:54242/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3136 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3162 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3177 T16 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 3189 T16 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54245_
[junit4:junit4]   2> 3194 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54245_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54245_
[junit4:junit4]   2> 3196 T16 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54245_
[junit4:junit4]   2> 3211 T16 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 3256 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 3259 T16 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 3273 T16 oasc.Overseer.start Overseer (id=88911388300410883-127.0.0.1:54245_-n_0000000000) starting
[junit4:junit4]   2> 3277 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3312 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3317 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3328 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3335 T41 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 3349 T16 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 3361 T16 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3396 T40 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 3466 T42 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108/collection1
[junit4:junit4]   2> 3467 T42 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 3470 T42 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3471 T42 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 3477 T42 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108/collection1/'
[junit4:junit4]   2> 3479 T42 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3480 T42 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108/collection1/lib/README' to classloader
[junit4:junit4]   2> 3691 T42 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 3879 T42 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3882 T42 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3973 T42 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4976 T42 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4996 T42 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5001 T42 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5097 T42 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5117 T42 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5131 T42 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5141 T42 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5152 T42 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356680120108/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/control/data/
[junit4:junit4]   2> 5154 T42 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dc511cb
[junit4:junit4]   2> 5157 T42 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 5180 T42 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/control/data forceNew:false
[junit4:junit4]   2> 5181 T42 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/control/data
[junit4:junit4]   2> 5182 T42 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/control/data/index/
[junit4:junit4]   2> 5183 T42 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5185 T42 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/control/data/index forceNew:false
[junit4:junit4]   2> 5192 T42 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@77718e0b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5193 T42 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5194 T42 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/control/data/index
[junit4:junit4]   2> 5195 T42 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5199 T42 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5200 T42 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5202 T42 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5202 T42 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5204 T42 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5204 T42 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5205 T42 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5207 T42 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5209 T42 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5210 T42 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5211 T42 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5212 T42 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5214 T42 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5214 T42 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5215 T42 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5222 T42 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5223 T42 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5224 T42 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5226 T42 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5227 T42 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5228 T42 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5230 T42 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5231 T42 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5233 T42 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5247 T42 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5248 T42 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5260 T42 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5267 T42 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5271 T42 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5275 T42 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/control/data
[junit4:junit4]   2> 5278 T42 oass.SolrIndexSearcher.<init> Opening Searcher@31cf2fc4 main
[junit4:junit4]   2> 5280 T42 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5280 T42 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5282 T42 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5291 T42 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5338 T43 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@31cf2fc4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5349 T42 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5349 T42 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5351 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:create cxid:0x59 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 5445 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5447 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54245_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54245"}
[junit4:junit4]   2> 5448 T40 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 5466 T40 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5468 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:create cxid:0x61 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 5493 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 6362 T42 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6363 T42 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54245 collection:control_collection shard:shard1
[junit4:junit4]   2> 6374 T42 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 6387 T42 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 6404 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:delete cxid:0x7e zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 6406 T42 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6407 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:create cxid:0x7f zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6411 T42 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6412 T42 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6412 T42 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54245/collection1/
[junit4:junit4]   2> 6413 T42 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6414 T42 oasc.SyncStrategy.syncToMe http://127.0.0.1:54245/collection1/ has no replicas
[junit4:junit4]   2> 6414 T42 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54245/collection1/
[junit4:junit4]   2> 6415 T42 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 6426 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220003 type:create cxid:0x89 zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6512 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6534 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 6585 T42 oasc.ZkController.register We are http://127.0.0.1:54245/collection1/ and leader is http://127.0.0.1:54245/collection1/
[junit4:junit4]   2> 6585 T42 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54245
[junit4:junit4]   2> 6586 T42 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6587 T42 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6587 T42 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6591 T42 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6594 T16 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6595 T16 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6630 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6646 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 6664 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@f1e793c
[junit4:junit4]   2> 6666 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6668 T44 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 6670 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54248
[junit4:junit4]   2> 6671 T44 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 6672 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54248
[junit4:junit4]   2> 6675 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc4220004 with negotiated timeout 10000 for client /127.0.0.1:54248
[junit4:junit4]   2> 6675 T44 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc4220004, negotiated timeout = 10000
[junit4:junit4]   2> 6676 T45 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f1e793c name:ZooKeeperConnection Watcher:127.0.0.1:54242/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6677 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6681 T16 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6689 T16 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 6867 T16 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6870 T16 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54249
[junit4:junit4]   2> 6872 T16 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6873 T16 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627
[junit4:junit4]   2> 6874 T16 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627/'
[junit4:junit4]   2> 6907 T16 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6908 T16 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6909 T16 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627
[junit4:junit4]   2> 6910 T16 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627/solr.xml
[junit4:junit4]   2> 6911 T16 oasc.CoreContainer.<init> New CoreContainer 994043862
[junit4:junit4]   2> 6912 T16 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627/'
[junit4:junit4]   2> 6913 T16 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627/'
[junit4:junit4]   2> 6944 T16 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 6945 T16 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6946 T16 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 6947 T16 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6948 T16 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6948 T16 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6949 T16 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6950 T16 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6951 T16 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6952 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 6981 T16 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7009 T16 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54242/solr
[junit4:junit4]   2> 7010 T16 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7011 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@58baaf66
[junit4:junit4]   2> 7012 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7013 T55 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7016 T55 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 7016 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54250
[junit4:junit4]   2> 7017 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54250
[junit4:junit4]   2> 7019 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc4220005 with negotiated timeout 20000 for client /127.0.0.1:54250
[junit4:junit4]   2> 7019 T55 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc4220005, negotiated timeout = 20000
[junit4:junit4]   2> 7020 T56 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58baaf66 name:ZooKeeperConnection Watcher:127.0.0.1:54242 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7020 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7023 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be06fc4220005
[junit4:junit4]   2> 7025 T18 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54250 which had sessionid 0x13be06fc4220005
[junit4:junit4]   2> 7026 T56 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7026 T16 oaz.ZooKeeper.close Session: 0x13be06fc4220005 closed
[junit4:junit4]   2> 7027 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 7033 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@22f46577
[junit4:junit4]   2> 7034 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7035 T57 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7036 T57 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 7037 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54251
[junit4:junit4]   2> 7038 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54251
[junit4:junit4]   2> 7040 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc4220006 with negotiated timeout 20000 for client /127.0.0.1:54251
[junit4:junit4]   2> 7040 T57 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc4220006, negotiated timeout = 20000
[junit4:junit4]   2> 7041 T58 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22f46577 name:ZooKeeperConnection Watcher:127.0.0.1:54242/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7041 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7043 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7046 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7050 T16 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54249_
[junit4:junit4]   2> 7052 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220006 type:delete cxid:0x4 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54249_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54249_
[junit4:junit4]   2> 7065 T16 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54249_
[junit4:junit4]   2> 7067 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7073 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54245_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54245"}
[junit4:junit4]   2> 7082 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 7086 T45 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 7094 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7108 T39 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 7109 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7108 T16 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7121 T59 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627/collection1
[junit4:junit4]   2> 7122 T59 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7124 T59 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7125 T59 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7129 T59 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627/collection1/'
[junit4:junit4]   2> 7130 T59 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7131 T59 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627/collection1/lib/README' to classloader
[junit4:junit4]   2> 7388 T59 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 7830 T59 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7841 T59 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7897 T59 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8944 T59 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8975 T59 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8983 T59 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9071 T59 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9095 T59 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9110 T59 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9118 T59 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9125 T59 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356680125627/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1/
[junit4:junit4]   2> 9125 T59 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dc511cb
[junit4:junit4]   2> 9135 T59 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 9137 T59 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1 forceNew:false
[junit4:junit4]   2> 9137 T59 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1
[junit4:junit4]   2> 9138 T59 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1/index/
[junit4:junit4]   2> 9139 T59 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9140 T59 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1/index forceNew:false
[junit4:junit4]   2> 9148 T59 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@282e6ef4; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9149 T59 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 9151 T59 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1/index
[junit4:junit4]   2> 9152 T59 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 9159 T59 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9160 T59 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 9161 T59 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9161 T59 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 9162 T59 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9163 T59 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9163 T59 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9164 T59 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9166 T59 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9167 T59 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 9168 T59 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 9169 T59 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9170 T59 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 9171 T59 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 9171 T59 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 9172 T59 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9174 T59 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9175 T59 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9177 T59 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9179 T59 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9180 T59 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9181 T59 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9182 T59 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9183 T59 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9184 T59 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 9185 T59 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 9196 T59 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9203 T59 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 9208 T59 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 9216 T59 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1
[junit4:junit4]   2> 9219 T59 oass.SolrIndexSearcher.<init> Opening Searcher@6f9435 main
[junit4:junit4]   2> 9222 T59 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9223 T59 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9226 T59 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 9239 T59 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 9339 T60 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6f9435 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9365 T59 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 9366 T59 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9645 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9648 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54249_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54249"}
[junit4:junit4]   2> 9648 T40 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 9649 T40 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9668 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9669 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 9673 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10373 T59 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 10375 T59 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54249 collection:collection1 shard:shard1
[junit4:junit4]   2> 10378 T59 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 10403 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220006 type:delete cxid:0x43 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 10405 T59 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 10406 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220006 type:create cxid:0x44 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10416 T59 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 10417 T59 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 10418 T59 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54249/collection1/
[junit4:junit4]   2> 10418 T59 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 10419 T59 oasc.SyncStrategy.syncToMe http://127.0.0.1:54249/collection1/ has no replicas
[junit4:junit4]   2> 10420 T59 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54249/collection1/
[junit4:junit4]   2> 10420 T59 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 10434 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220006 type:create cxid:0x4e zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10716 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10762 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10763 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10765 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 10804 T59 oasc.ZkController.register We are http://127.0.0.1:54249/collection1/ and leader is http://127.0.0.1:54249/collection1/
[junit4:junit4]   2> 10806 T59 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54249
[junit4:junit4]   2> 10807 T59 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 10808 T59 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 10809 T59 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10821 T59 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10828 T16 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 10830 T16 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 10832 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 11282 T16 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 11290 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11296 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54249_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54249"}
[junit4:junit4]   2> 11321 T16 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54252
[junit4:junit4]   2> 11324 T16 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11328 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11327 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11327 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11331 T16 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790
[junit4:junit4]   2> 11345 T16 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790/'
[junit4:junit4]   2> 11423 T16 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 11425 T16 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11426 T16 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790
[junit4:junit4]   2> 11427 T16 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790/solr.xml
[junit4:junit4]   2> 11429 T16 oasc.CoreContainer.<init> New CoreContainer 1150672298
[junit4:junit4]   2> 11431 T16 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790/'
[junit4:junit4]   2> 11432 T16 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790/'
[junit4:junit4]   2> 11483 T16 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 11499 T16 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11506 T16 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 11516 T16 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11522 T16 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11524 T16 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11525 T16 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11527 T16 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11528 T16 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11531 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 11601 T16 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11830 T16 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54242/solr
[junit4:junit4]   2> 11831 T16 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11832 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4e5a67df
[junit4:junit4]   2> 11834 T70 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11835 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11837 T70 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 11843 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54253
[junit4:junit4]   2> 11846 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54253
[junit4:junit4]   2> 11849 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc4220007 with negotiated timeout 20000 for client /127.0.0.1:54253
[junit4:junit4]   2> 11849 T70 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc4220007, negotiated timeout = 20000
[junit4:junit4]   2> 11851 T71 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e5a67df name:ZooKeeperConnection Watcher:127.0.0.1:54242 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11853 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11859 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be06fc4220007
[junit4:junit4]   2> 11861 T18 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54253 which had sessionid 0x13be06fc4220007
[junit4:junit4]   2> 11868 T71 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11869 T16 oaz.ZooKeeper.close Session: 0x13be06fc4220007 closed
[junit4:junit4]   2> 11871 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 11881 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@5374edfd
[junit4:junit4]   2> 11888 T72 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 11890 T72 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 11891 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54254
[junit4:junit4]   2> 11891 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11893 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54254
[junit4:junit4]   2> 11896 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc4220008 with negotiated timeout 20000 for client /127.0.0.1:54254
[junit4:junit4]   2> 11896 T72 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc4220008, negotiated timeout = 20000
[junit4:junit4]   2> 11898 T73 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5374edfd name:ZooKeeperConnection Watcher:127.0.0.1:54242/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11899 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11905 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220008 type:create cxid:0x1 zxid:0x71 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11908 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220008 type:create cxid:0x2 zxid:0x72 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11912 T16 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54252_
[junit4:junit4]   2> 11923 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220008 type:delete cxid:0x4 zxid:0x73 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54252_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54252_
[junit4:junit4]   2> 11938 T16 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54252_
[junit4:junit4]   2> 11953 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11958 T58 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 11959 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11960 T45 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 11961 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11976 T39 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 12008 T16 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12050 T74 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790/collection1
[junit4:junit4]   2> 12053 T74 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 12059 T74 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 12060 T74 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 12070 T74 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790/collection1/'
[junit4:junit4]   2> 12071 T74 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 12072 T74 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790/collection1/lib/README' to classloader
[junit4:junit4]   2> 12188 T74 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 12312 T74 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 12315 T74 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 12383 T74 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 13664 T74 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 13682 T74 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 13687 T74 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 13767 T74 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13783 T74 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13798 T74 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13807 T74 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13815 T74 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356680129790/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty2/
[junit4:junit4]   2> 13816 T74 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dc511cb
[junit4:junit4]   2> 13817 T74 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 13818 T74 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty2 forceNew:false
[junit4:junit4]   2> 13819 T74 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty2
[junit4:junit4]   2> 13819 T74 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty2/index/
[junit4:junit4]   2> 13820 T74 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 13821 T74 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty2/index forceNew:false
[junit4:junit4]   2> 13833 T74 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3193fea8; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13835 T74 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13836 T74 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty2/index
[junit4:junit4]   2> 13837 T74 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 13842 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 13843 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 13844 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 13844 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 13846 T74 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 13848 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 13850 T74 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 13853 T74 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 13855 T74 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 13857 T74 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 13868 T74 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 13869 T74 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 13870 T74 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 13871 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 13872 T74 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 13874 T74 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 13875 T74 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13877 T74 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13878 T74 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13880 T74 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13883 T74 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13886 T74 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13888 T74 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13891 T74 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13894 T74 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 13896 T74 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 13914 T74 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 13922 T74 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 13929 T74 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 13943 T74 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty2
[junit4:junit4]   2> 13946 T74 oass.SolrIndexSearcher.<init> Opening Searcher@26fc8079 main
[junit4:junit4]   2> 13950 T74 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 13952 T74 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 13954 T74 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 13971 T74 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 14058 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@26fc8079 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 14092 T74 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 14093 T74 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14424 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14428 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54252_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54252"}
[junit4:junit4]   2> 14428 T40 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 14429 T40 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 14446 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14446 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14447 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 14447 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15098 T74 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 15100 T74 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54252 collection:collection1 shard:shard2
[junit4:junit4]   2> 15102 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 15121 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220008 type:delete cxid:0x42 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 15124 T74 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 15126 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220008 type:create cxid:0x43 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15135 T74 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 15137 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 15137 T74 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54252/collection1/
[junit4:junit4]   2> 15138 T74 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 15139 T74 oasc.SyncStrategy.syncToMe http://127.0.0.1:54252/collection1/ has no replicas
[junit4:junit4]   2> 15140 T74 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54252/collection1/
[junit4:junit4]   2> 15141 T74 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 15162 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc4220008 type:create cxid:0x4c zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15473 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15502 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15503 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15503 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15502 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 15532 T74 oasc.ZkController.register We are http://127.0.0.1:54252/collection1/ and leader is http://127.0.0.1:54252/collection1/
[junit4:junit4]   2> 15533 T74 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54252
[junit4:junit4]   2> 15534 T74 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 15535 T74 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 15536 T74 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15542 T74 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15547 T16 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 15548 T16 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 15550 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 15985 T16 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 15997 T16 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54255
[junit4:junit4]   2> 16000 T16 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 16002 T16 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503
[junit4:junit4]   2> 16004 T16 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503/'
[junit4:junit4]   2> 16030 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16040 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54252_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54252"}
[junit4:junit4]   2> 16072 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 16073 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 16072 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 16073 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 16102 T16 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 16105 T16 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 16107 T16 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503
[junit4:junit4]   2> 16108 T16 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503/solr.xml
[junit4:junit4]   2> 16109 T16 oasc.CoreContainer.<init> New CoreContainer 718406525
[junit4:junit4]   2> 16113 T16 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503/'
[junit4:junit4]   2> 16117 T16 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503/'
[junit4:junit4]   2> 16229 T16 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 16231 T16 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 16234 T16 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 16236 T16 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 16237 T16 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 16241 T16 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 16243 T16 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 16244 T16 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 16246 T16 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 16248 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 16296 T16 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 16373 T16 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54242/solr
[junit4:junit4]   2> 16374 T16 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 16376 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6c32e579
[junit4:junit4]   2> 16379 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16380 T85 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 16386 T85 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 16389 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54256
[junit4:junit4]   2> 16392 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54256
[junit4:junit4]   2> 16396 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc4220009 with negotiated timeout 20000 for client /127.0.0.1:54256
[junit4:junit4]   2> 16397 T85 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc4220009, negotiated timeout = 20000
[junit4:junit4]   2> 16399 T86 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c32e579 name:ZooKeeperConnection Watcher:127.0.0.1:54242 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16400 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16432 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be06fc4220009
[junit4:junit4]   2> 16437 T18 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54256 which had sessionid 0x13be06fc4220009
[junit4:junit4]   2> 16439 T86 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16441 T16 oaz.ZooKeeper.close Session: 0x13be06fc4220009 closed
[junit4:junit4]   2> 16444 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 16456 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@62067ba5
[junit4:junit4]   2> 16459 T87 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 16460 T87 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 16461 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54257
[junit4:junit4]   2> 16458 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16464 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54257
[junit4:junit4]   2> 16467 T87 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc422000a, negotiated timeout = 20000
[junit4:junit4]   2> 16468 T88 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62067ba5 name:ZooKeeperConnection Watcher:127.0.0.1:54242/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16468 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc422000a with negotiated timeout 20000 for client /127.0.0.1:54257
[junit4:junit4]   2> 16471 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16476 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc422000a type:create cxid:0x1 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16481 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc422000a type:create cxid:0x2 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16488 T16 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54255_
[junit4:junit4]   2> 16491 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc422000a type:delete cxid:0x4 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54255_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54255_
[junit4:junit4]   2> 16494 T16 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54255_
[junit4:junit4]   2> 16511 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 16513 T45 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 16514 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 16515 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16518 T58 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 16519 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 16525 T73 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 16537 T39 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 16569 T16 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 16604 T89 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503/collection1
[junit4:junit4]   2> 16605 T89 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 16608 T89 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 16609 T89 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 16613 T89 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503/collection1/'
[junit4:junit4]   2> 16615 T89 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 16616 T89 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503/collection1/lib/README' to classloader
[junit4:junit4]   2> 16756 T89 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 16983 T89 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 16996 T89 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 17063 T89 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 18098 T89 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 18134 T89 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 18143 T89 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 18217 T89 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 18229 T89 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 18238 T89 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 18248 T89 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 18254 T89 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356680134503/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/
[junit4:junit4]   2> 18255 T89 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dc511cb
[junit4:junit4]   2> 18256 T89 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 18258 T89 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3 forceNew:false
[junit4:junit4]   2> 18259 T89 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3
[junit4:junit4]   2> 18259 T89 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index/
[junit4:junit4]   2> 18260 T89 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 18263 T89 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index forceNew:false
[junit4:junit4]   2> 18278 T89 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6591dc3d; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 18280 T89 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 18283 T89 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index
[junit4:junit4]   2> 18284 T89 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 18295 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 18296 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 18297 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 18300 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 18305 T89 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 18306 T89 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 18307 T89 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 18308 T89 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 18310 T89 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 18311 T89 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 18312 T89 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 18313 T89 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 18315 T89 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 18315 T89 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 18316 T89 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 18317 T89 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 18319 T89 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 18320 T89 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 18321 T89 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 18323 T89 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 18324 T89 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 18325 T89 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 18327 T89 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 18329 T89 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 18330 T89 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 18331 T89 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 18340 T89 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 18346 T89 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 18349 T89 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 18351 T89 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3
[junit4:junit4]   2> 18352 T89 oass.SolrIndexSearcher.<init> Opening Searcher@173a0c9b main
[junit4:junit4]   2> 18353 T89 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 18353 T89 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 18355 T89 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 18360 T89 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 18415 T90 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@173a0c9b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 18443 T89 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 18443 T89 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18663 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18666 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54255_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54255"}
[junit4:junit4]   2> 18667 T40 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 18668 T40 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 18686 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18687 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18688 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18687 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 18688 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19448 T89 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 19449 T89 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54255 collection:collection1 shard:shard1
[junit4:junit4]   2> 19458 T89 oasc.ZkController.register We are http://127.0.0.1:54255/collection1/ and leader is http://127.0.0.1:54249/collection1/
[junit4:junit4]   2> 19458 T89 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54255
[junit4:junit4]   2> 19459 T89 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 19459 T89 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@74070ee9 url=http://127.0.0.1:54255/collection1 node=127.0.0.1:54255_ C2_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:54255_, base_url=http://127.0.0.1:54255}
[junit4:junit4]   2> 19465 T91 C2 P54255 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 19467 T91 C2 P54255 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 19467 T89 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19467 T91 C2 P54255 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 19468 T91 C2 P54255 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 19470 T16 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 19471 T16 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 19473 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19480 T91 C2 P54255 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 19738 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19741 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54255_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54255"}
[junit4:junit4]   2> 19763 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19764 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19765 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19765 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19765 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 19962 T16 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 19970 T16 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54258
[junit4:junit4]   2> 19973 T16 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 19975 T16 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428
[junit4:junit4]   2> 19975 T16 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428/'
[junit4:junit4]   2> 20039 T16 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 20040 T16 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 20041 T16 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428
[junit4:junit4]   2> 20042 T16 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428/solr.xml
[junit4:junit4]   2> 20043 T16 oasc.CoreContainer.<init> New CoreContainer 978730539
[junit4:junit4]   2> 20048 T16 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428/'
[junit4:junit4]   2> 20053 T16 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428/'
[junit4:junit4]   2> 20095 T16 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 20100 T16 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 20101 T16 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 20102 T16 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 20102 T16 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 20105 T16 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 20106 T16 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 20106 T16 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 20107 T16 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 20108 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 20140 T16 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 20199 T16 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:54242/solr
[junit4:junit4]   2> 20201 T16 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 20202 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@518a2f90
[junit4:junit4]   2> 20205 T101 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 20205 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 20207 T101 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 20209 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54259
[junit4:junit4]   2> 20209 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54259
[junit4:junit4]   2> 20211 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc422000b with negotiated timeout 20000 for client /127.0.0.1:54259
[junit4:junit4]   2> 20212 T101 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc422000b, negotiated timeout = 20000
[junit4:junit4]   2> 20213 T102 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@518a2f90 name:ZooKeeperConnection Watcher:127.0.0.1:54242 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 20217 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 20227 T21 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13be06fc422000b
[junit4:junit4]   2> 20230 T18 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:54259 which had sessionid 0x13be06fc422000b
[junit4:junit4]   2> 20231 T102 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 20231 T16 oaz.ZooKeeper.close Session: 0x13be06fc422000b closed
[junit4:junit4]   2> 20233 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 20257 T16 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:54242/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4b38d375
[junit4:junit4]   2> 20267 T103 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:54242. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 20270 T103 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:54242, initiating session
[junit4:junit4]   2> 20271 T18 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:54261
[junit4:junit4]   2> 20272 T18 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:54261
[junit4:junit4]   2> 20272 T16 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 20277 T103 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:54242, sessionid = 0x13be06fc422000c, negotiated timeout = 20000
[junit4:junit4]   2> 20276 T20 oazs.ZooKeeperServer.finishSessionInit Established session 0x13be06fc422000c with negotiated timeout 20000 for client /127.0.0.1:54261
[junit4:junit4]   2> 20279 T104 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b38d375 name:ZooKeeperConnection Watcher:127.0.0.1:54242/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 20279 T16 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 20281 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc422000c type:create cxid:0x1 zxid:0xa6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 20286 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc422000c type:create cxid:0x2 zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 20300 T16 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54258_
[junit4:junit4]   2> 20304 T21 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13be06fc422000c type:delete cxid:0x4 zxid:0xa8 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:54258_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:54258_
[junit4:junit4]   2> 20317 T16 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54258_
[junit4:junit4]   2> 20340 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20341 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 20344 T45 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 20345 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20344 T88 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 20347 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20348 T58 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 20349 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 20357 T73 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 20372 T39 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 20476 T16 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 20506 T105 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428/collection1
[junit4:junit4]   2> 20507 T105 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 20509 T105 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 20510 T105 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 20516 T105 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428/collection1/'
[junit4:junit4]   2> 20521 T105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 20523 T105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428/collection1/lib/README' to classloader
[junit4:junit4]   2> 20708 T105 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 21029 T105 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 21037 T105 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 21069 T105 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 22060 T105 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 22079 T105 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 22083 T105 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 22123 T105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 22135 T105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 22142 T105 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 22147 T105 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 22151 T105 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356680138428/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty4/
[junit4:junit4]   2> 22151 T105 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@dc511cb
[junit4:junit4]   2> 22152 T105 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 22154 T105 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty4 forceNew:false
[junit4:junit4]   2> 22155 T105 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty4
[junit4:junit4]   2> 22155 T105 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty4/index/
[junit4:junit4]   2> 22156 T105 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 22157 T105 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty4/index forceNew:false
[junit4:junit4]   2> 22163 T105 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7510a4da; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 22163 T105 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 22164 T105 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty4/index
[junit4:junit4]   2> 22165 T105 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 22170 T105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 22171 T105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 22172 T105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 22172 T105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 22175 T105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 22175 T105 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 22177 T105 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 22178 T105 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 22179 T105 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 22180 T105 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 22182 T105 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 22183 T105 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 22185 T105 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 22186 T105 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 22187 T105 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 22189 T105 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 22190 T105 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 22192 T105 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 22193 T105 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 22194 T105 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 22195 T105 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 22197 T105 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 22201 T105 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 22202 T105 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 22203 T105 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 22204 T105 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 22213 T105 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 22217 T105 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 22221 T105 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 22230 T105 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty4
[junit4:junit4]   2> 22232 T105 oass.SolrIndexSearcher.<init> Opening Searcher@807f8e main
[junit4:junit4]   2> 22234 T105 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 22235 T105 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 22236 T105 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 22246 T105 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 22341 T106 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@807f8e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 22362 T105 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 22363 T105 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 22819 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 22821 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54258_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54258"}
[junit4:junit4]   2> 22822 T40 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 22822 T40 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 22832 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22833 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22834 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22835 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22836 T104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 22836 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2>  C2_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:54255_, base_url=http://127.0.0.1:54255}
[junit4:junit4]   2> 23238 T91 C2 P54255 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:54249/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 23244 T91 C2 P54255 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   2> 23255 T91 C2 P54255 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:54255 START replicas=[http://127.0.0.1:54249/collection1/] nUpdates=100
[junit4:junit4]   2> 23260 T91 C2 P54255 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 23262 T91 C2 P54255 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 23262 T91 C2 P54255 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 23263 T91 C2 P54255 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 23263 T91 C2 P54255 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 23263 T91 C2 P54255 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:54249/collection1/. core=collection1
[junit4:junit4]   2> 23264 T91 C2 P54255 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@1eb01669 url=http://127.0.0.1:54249/collection1 node=127.0.0.1:54249_ C3_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:54249_, base_url=http://127.0.0.1:54249, leader=true}
[junit4:junit4]   2> 23318 T54 C3 P54249 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=18 
[junit4:junit4]   2> 23323 T49 C3 P54249 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 23325 T49 C3 P54249 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1
[junit4:junit4]   2> 23332 T49 C3 P54249 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@282e6ef4; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 23333 T49 C3 P54249 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 23341 T49 C3 P54249 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@282e6ef4; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@282e6ef4; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 23342 T49 C3 P54249 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 23343 T49 C3 P54249 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1
[junit4:junit4]   2> 23344 T49 C3 P54249 oass.SolrIndexSearcher.<init> Opening Searcher@3982b57d realtime
[junit4:junit4]   2> 23345 T49 C3 P54249 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 23346 T49 C3 P54249 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 45
[junit4:junit4]   2> 23368 T105 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 23369 T105 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54258 collection:collection1 shard:shard2
[junit4:junit4]   2> 23386 T105 oasc.ZkController.register We are http://127.0.0.1:54258/collection1/ and leader is http://127.0.0.1:54252/collection1/
[junit4:junit4]   2> 23387 T105 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54258
[junit4:junit4]   2> 23387 T105 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 23388 T105 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@46db97c0 url=http://127.0.0.1:54258/collection1 node=127.0.0.1:54258_ C4_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:54258_, base_url=http://127.0.0.1:54258}
[junit4:junit4]   2> 23389 T108 C4 P54258 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 23391 T108 C4 P54258 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 23391 T108 C4 P54258 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 23392 T108 C4 P54258 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 23398 T105 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23399 T108 C4 P54258 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 23406 T91 C2 P54255 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 23406 T91 C2 P54255 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4]   2> 23411 T16 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 23412 T16 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 23413 T16 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 23442 T91 C2 P54255 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 23445 T16 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23461 T16 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 23465 T16 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23490 T50 C3 P54249 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 23491 T50 C3 P54249 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=42 
[junit4:junit4]   2> 23493 T91 C2 P54255 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 23493 T91 C2 P54255 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 23494 T91 C2 P54255 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 23501 T52 C3 P54249 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1
[junit4:junit4]   2> 23502 T52 C3 P54249 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty1/index
[junit4:junit4]   2> 23503 T52 C3 P54249 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=4 
[junit4:junit4]   2> 23505 T91 C2 P54255 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 23507 T91 C2 P54255 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index.20121228173542443 forceNew:false
[junit4:junit4]   2> 23508 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3
[junit4:junit4]   2> 23510 T91 C2 P54255 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index.20121228173542443 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3acfa8c4; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 23522 T51 C3 P54249 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=3 
[junit4:junit4]   2> 23540 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index
[junit4:junit4]   2> 23541 T91 C2 P54255 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 23542 T91 C2 P54255 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121228173542443
[junit4:junit4]   2> 23549 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3
[junit4:junit4]   2> 23550 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3
[junit4:junit4]   2> 23551 T91 C2 P54255 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index.20121228173542443
[junit4:junit4]   2> 23555 T91 C2 P54255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index.20121228173542443 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3acfa8c4; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 23556 T91 C2 P54255 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 23558 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3
[junit4:junit4]   2> 23560 T91 C2 P54255 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 23561 T91 C2 P54255 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 23561 T91 C2 P54255 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 23563 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index.20121228173542443
[junit4:junit4]   2> 23564 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3
[junit4:junit4]   2> 23569 T91 C2 P54255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index.20121228173542443 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3acfa8c4; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 23570 T91 C2 P54255 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 23570 T91 C2 P54255 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 23571 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3
[junit4:junit4]   2> 23572 T91 C2 P54255 oass.SolrIndexSearcher.<init> Opening Searcher@4ddc7d76 main
[junit4:junit4]   2> 23578 T90 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4ddc7d76 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 23579 T90 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index
[junit4:junit4]   2> 23580 T91 C2 P54255 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 23583 T91 C2 P54255 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index.20121228173542443 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3acfa8c4; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index.20121228173542443 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3acfa8c4; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 23584 T91 C2 P54255 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 23586 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3
[junit4:junit4]   2> 23586 T91 C2 P54255 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 23587 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index.20121228173542443
[junit4:junit4]   2> 23588 T91 C2 P54255 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356680118983/jetty3/index
[junit4:junit4]   2> 23589 T91 C2 P54255 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 23591 T91 C2 P54255 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 23591 T91 C2 P54255 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 23592 T91 C2 P54255 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 23616 T91 C2 P54255 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 23863 T40 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 23865 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54258_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54258"}
[junit4:junit4]   2> 23873 T40 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:54255_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:54255"}
[junit4:junit4]   2> 23883 T39 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23884 T88 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23885 T45 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23886 T104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23886 T58 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 23890 T73 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 24471 T16 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 25480 T16 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C4_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:54258_, base_url=http://127.0.0.1:54258}
[junit4:junit4]   2> 26438 T108 C4 P54258 oasc.

[...truncated too long message...]

                "base_url":"http://127.0.0.1:54245",
[junit4:junit4]   1>                   "leader":"true"}}}},
[junit4:junit4]   1>           "router":"compositeId"}}
[junit4:junit4]   1>  /zookeeper (1)
[junit4:junit4]   1>  DATA:
[junit4:junit4]   1>      
[junit4:junit4]   1> 
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=B78E2D935646536A -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=Australia/Queensland -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE  394s | BasicDistributedZkTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([B78E2D935646536A:3668A38B21193356]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:175)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:125)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:120)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.testCoreUnloadAndLeaders(BasicDistributedZkTest.java:586)
[junit4:junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:337)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 393848 T16 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 394210 T15 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {n_f1=PostingsFormat(name=Memory doPackFST= false), foo_b=PostingsFormat(name=SimpleText), cat=PostingsFormat(name=MockSep), foo_d=PostingsFormat(name=Asserting), foo_f=PostingsFormat(name=SimpleText), n_tl1=PostingsFormat(name=Memory doPackFST= false), n_d1=PostingsFormat(name=MockSep), rnd_b=PostingsFormat(name=Asserting), intDefault=PostingsFormat(name=Memory doPackFST= false), n_td1=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=MockSep), id=PostingsFormat(name=Asserting), range_facet_sl=PostingsFormat(name=Asserting), range_facet_si=PostingsFormat(name=MockSep), oddField_s=PostingsFormat(name=Asserting), sequence_i=PostingsFormat(name=Asserting), name=PostingsFormat(name=Asserting), foo_i=PostingsFormat(name=Memory doPackFST= false), regex_dup_B_s=PostingsFormat(name=MockSep), multiDefault=PostingsFormat(name=MockSep), n_tf1=PostingsFormat(name=MockSep), n_dt1=PostingsFormat(name=Memory doPackFST= false), genre_s=PostingsFormat(name=Asserting), author_t=PostingsFormat(name=Memory doPackFST= false), n_ti1=PostingsFormat(name=Asserting), range_facet_l=PostingsFormat(name=MockSep), text=PostingsFormat(name=SimpleText), _version_=PostingsFormat(name=Memory doPackFST= false), val_i=PostingsFormat(name=Asserting), SubjectTerms_mfacet=PostingsFormat(name=Memory doPackFST= false), series_t=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=MockSep), n_tdt1=PostingsFormat(name=Memory doPackFST= false), regex_dup_A_s=PostingsFormat(name=SimpleText), price=PostingsFormat(name=SimpleText), other_tl1=PostingsFormat(name=Memory doPackFST= false), n_l1=PostingsFormat(name=MockSep), a_si=PostingsFormat(name=Memory doPackFST= false), inStock=PostingsFormat(name=SimpleText)}, sim=DefaultSimilarity, locale=hu, timezone=Australia/Queensland
[junit4:junit4]   2> NOTE: Mac OS X 10.8.2 x86_64/Oracle Corporation 1.7.0_10 (64-bit)/cpus=2,threads=1,free=39563784,total=100724736
[junit4:junit4]   2> NOTE: All tests run in this JVM: [FileUtilsTest, TestAtomicUpdateErrorCases, BasicDistributedZkTest]
[junit4:junit4] Completed in 394.59s, 1 test, 1 failure <<< FAILURES!

[...truncated 732 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:353: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:178: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:438: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1176: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:841: There were test failures: 243 suites, 1009 tests, 1 failure, 13 ignored (2 assumptions)

Total time: 185 minutes 51 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build # 8 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/8/
Java: 64bit/jdk1.6.0 -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([CFAA6DC550223852:71210B6A29583667]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterStateUpdateTest.java:234)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:680)




Build Log:
[...truncated 8297 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ClusterStateUpdateTest
[junit4:junit4]   2> 6 T1662 oas.SolrTestCaseJ4.setUp ###Starting testCoreRegistration
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096
[junit4:junit4]   2> 8 T1662 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 9 T1663 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 12 T1663 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 12 T1663 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 12 T1663 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 13 T1663 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 14 T1663 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 113 T1662 oasc.ZkTestServer.run start zk server on port:53051
[junit4:junit4]   2> 114 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@75c93c33
[junit4:junit4]   2> 115 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 116 T1668 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 117 T1668 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 118 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53052
[junit4:junit4]   2> 118 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53052
[junit4:junit4]   2> 119 T1666 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 121 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d810000 with negotiated timeout 10000 for client /127.0.0.1:53052
[junit4:junit4]   2> 122 T1668 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d810000, negotiated timeout = 10000
[junit4:junit4]   2> 127 T1669 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75c93c33 name:ZooKeeperConnection Watcher:127.0.0.1:53051 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 127 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 128 T1662 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 134 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d810000
[junit4:junit4]   2> 139 T1669 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 140 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53052 which had sessionid 0x13bdfc76d810000
[junit4:junit4]   2> 139 T1662 oaz.ZooKeeper.close Session: 0x13bdfc76d810000 closed
[junit4:junit4]   2> 141 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2fc116d5
[junit4:junit4]   2> 142 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 143 T1670 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 144 T1670 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 145 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53053
[junit4:junit4]   2> 146 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53053
[junit4:junit4]   2> 148 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d810001 with negotiated timeout 10000 for client /127.0.0.1:53053
[junit4:junit4]   2> 148 T1670 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d810001, negotiated timeout = 10000
[junit4:junit4]   2> 148 T1671 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fc116d5 name:ZooKeeperConnection Watcher:127.0.0.1:53051/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 149 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 149 T1662 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 156 T1662 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 163 T1662 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 168 T1662 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 174 T1662 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 176 T1662 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 189 T1662 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 191 T1662 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 198 T1662 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 199 T1662 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 205 T1662 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 206 T1662 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 213 T1662 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 215 T1662 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 221 T1662 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 223 T1662 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 231 T1662 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 232 T1662 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 240 T1662 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 243 T1662 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 252 T1662 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 253 T1662 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 260 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d810001
[junit4:junit4]   2> 262 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53053 which had sessionid 0x13bdfc76d810001
[junit4:junit4]   2> 262 T1662 oaz.ZooKeeper.close Session: 0x13bdfc76d810001 closed
[junit4:junit4]   2> 262 T1671 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 263 T1662 oasc.ClusterStateUpdateTest.setUp ####SETUP_START testCoreRegistration
[junit4:junit4]   2> 268 T1662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 269 T1662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 270 T1662 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 270 T1662 oasc.CoreContainer.<init> New CoreContainer 1305632595
[junit4:junit4]   2> 271 T1662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 272 T1662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 300 T1662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 300 T1662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 300 T1662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 301 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 301 T1662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 301 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 302 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 302 T1662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 302 T1662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 303 T1662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 317 T1662 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 343 T1662 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53051/solr
[junit4:junit4]   2> 344 T1662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 345 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5643169a
[junit4:junit4]   2> 346 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 347 T1672 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 349 T1672 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 349 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53054
[junit4:junit4]   2> 350 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53054
[junit4:junit4]   2> 352 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d810002 with negotiated timeout 20000 for client /127.0.0.1:53054
[junit4:junit4]   2> 352 T1672 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d810002, negotiated timeout = 20000
[junit4:junit4]   2> 353 T1673 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5643169a name:ZooKeeperConnection Watcher:127.0.0.1:53051 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 353 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 356 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d810002
[junit4:junit4]   2> 357 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53054 which had sessionid 0x13bdfc76d810002
[junit4:junit4]   2> 357 T1662 oaz.ZooKeeper.close Session: 0x13bdfc76d810002 closed
[junit4:junit4]   2> 357 T1673 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 358 T1662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 372 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@1991c475
[junit4:junit4]   2> 374 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 375 T1674 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 376 T1674 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 377 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53055
[junit4:junit4]   2> 377 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53055
[junit4:junit4]   2> 379 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d810003 with negotiated timeout 3000 for client /127.0.0.1:53055
[junit4:junit4]   2> 380 T1674 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d810003, negotiated timeout = 3000
[junit4:junit4]   2> 380 T1675 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1991c475 name:ZooKeeperConnection Watcher:127.0.0.1:53051/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 381 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 394 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 397 T1662 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 403 T1662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 404 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1661_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 406 T1662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 415 T1662 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 438 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 440 T1662 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 446 T1662 oasc.Overseer.start Overseer (id=88910665292513283-127.0.0.1:1661_solr-n_0000000000) starting
[junit4:junit4]   2> 447 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 449 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 450 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 452 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 463 T1677 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 465 T1662 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 471 T1662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 484 T1678 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 484 T1676 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 484 T1678 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 486 T1678 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 487 T1678 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 490 T1678 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 491 T1678 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 492 T1678 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 544 T1678 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 644 T1678 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 647 T1678 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 657 T1678 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1793 T1678 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1819 T1678 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1825 T1678 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1855 T1678 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1864 T1678 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1871 T1678 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1874 T1678 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1877 T1678 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1/
[junit4:junit4]   2> 1878 T1678 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@767a9224
[junit4:junit4]   2> 1878 T1678 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 1879 T1678 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1 forceNew:false
[junit4:junit4]   2> 1880 T1678 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1
[junit4:junit4]   2> 1880 T1678 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1/index/
[junit4:junit4]   2> 1881 T1678 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1882 T1678 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1/index forceNew:false
[junit4:junit4]   2> 1884 T1678 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@74b85a7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@24f04e8b)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1884 T1678 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1885 T1678 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1/index
[junit4:junit4]   2> 1885 T1678 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1887 T1678 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1888 T1678 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1888 T1678 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1888 T1678 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1889 T1678 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1889 T1678 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1890 T1678 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1891 T1678 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1892 T1678 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1892 T1678 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1893 T1678 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1893 T1678 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1894 T1678 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1894 T1678 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1895 T1678 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1896 T1678 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1896 T1678 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1897 T1678 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1898 T1678 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1899 T1678 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1899 T1678 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1900 T1678 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1901 T1678 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1901 T1678 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1902 T1678 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1902 T1678 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1907 T1678 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1911 T1678 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1913 T1678 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1916 T1678 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1
[junit4:junit4]   2> 1917 T1678 oass.SolrIndexSearcher.<init> Opening Searcher@7a359e0 main
[junit4:junit4]   2> 1918 T1678 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1918 T1678 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1919 T1678 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1926 T1678 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1966 T1679 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7a359e0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1974 T1678 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1975 T1678 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1976 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x56 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2072 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2074 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 2074 T1676 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2076 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x5e zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2090 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2983 T1678 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2985 T1678 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1661/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 2986 T1678 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3002 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:delete cxid:0x7b zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3003 T1678 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 3004 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x7c zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3009 T1678 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 3009 T1678 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 3010 T1678 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 3010 T1678 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3020 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x86 zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3105 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3124 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3177 T1678 oasc.ZkController.register We are http://127.0.0.1:1661/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 3178 T1678 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 3178 T1678 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3179 T1678 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3182 T1678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3185 T1662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3186 T1662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 3186 T1662 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 3187 T1662 oasc.CoreContainer.<init> New CoreContainer 785540697
[junit4:junit4]   2> 3188 T1662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 3189 T1662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 3245 T1662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 3246 T1662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3246 T1662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3247 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3247 T1662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3248 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3248 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3249 T1662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3250 T1662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3250 T1662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 3275 T1662 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3307 T1662 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53051/solr
[junit4:junit4]   2> 3308 T1662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3308 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3a1c8a3c
[junit4:junit4]   2> 3310 T1680 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3314 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3316 T1680 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 3318 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53056
[junit4:junit4]   2> 3318 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53056
[junit4:junit4]   2> 3320 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d810004 with negotiated timeout 20000 for client /127.0.0.1:53056
[junit4:junit4]   2> 3320 T1680 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d810004, negotiated timeout = 20000
[junit4:junit4]   2> 3321 T1681 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a1c8a3c name:ZooKeeperConnection Watcher:127.0.0.1:53051 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3321 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3329 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d810004
[junit4:junit4]   2> 3330 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53056 which had sessionid 0x13bdfc76d810004
[junit4:junit4]   2> 3331 T1662 oaz.ZooKeeper.close Session: 0x13bdfc76d810004 closed
[junit4:junit4]   2> 3332 T1662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 3341 T1681 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3347 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@6676e2b9
[junit4:junit4]   2> 3350 T1682 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 3351 T1682 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 3352 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3353 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53057
[junit4:junit4]   2> 3354 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53057
[junit4:junit4]   2> 3356 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d810005 with negotiated timeout 3000 for client /127.0.0.1:53057
[junit4:junit4]   2> 3356 T1682 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d810005, negotiated timeout = 3000
[junit4:junit4]   2> 3357 T1683 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6676e2b9 name:ZooKeeperConnection Watcher:127.0.0.1:53051/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3357 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3358 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810005 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3360 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810005 type:create cxid:0x2 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3362 T1662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 3364 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810005 type:delete cxid:0x4 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1662_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 3365 T1662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 3373 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3376 T1662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3379 T1675 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 3392 T1684 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 3392 T1684 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 3393 T1684 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 3394 T1684 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 3396 T1684 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 3397 T1684 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 3398 T1684 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 3483 T1684 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 3634 T1684 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 3637 T1684 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 3645 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3648 T1684 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 3656 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 3729 T1683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 3730 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4677 T1684 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 4686 T1684 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 4690 T1684 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 4717 T1684 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4724 T1684 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 4730 T1684 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4732 T1684 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 4734 T1684 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2/
[junit4:junit4]   2> 4735 T1684 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@767a9224
[junit4:junit4]   2> 4735 T1684 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 4736 T1684 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2 forceNew:false
[junit4:junit4]   2> 4737 T1684 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2
[junit4:junit4]   2> 4737 T1684 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2/index/
[junit4:junit4]   2> 4737 T1684 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 4738 T1684 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2/index forceNew:false
[junit4:junit4]   2> 4740 T1684 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5a74fae4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2f75dd3b)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 4740 T1684 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 4741 T1684 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2/index
[junit4:junit4]   2> 4741 T1684 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 4744 T1684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 4744 T1684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 4744 T1684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 4745 T1684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 4745 T1684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 4746 T1684 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 4746 T1684 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 4747 T1684 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 4747 T1684 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 4748 T1684 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 4748 T1684 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 4749 T1684 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 4749 T1684 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 4749 T1684 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 4750 T1684 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 4751 T1684 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 4751 T1684 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4752 T1684 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4752 T1684 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4753 T1684 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4753 T1684 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4754 T1684 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4755 T1684 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4756 T1684 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 4757 T1684 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 4758 T1684 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 4764 T1684 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 4767 T1684 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 4769 T1684 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 4771 T1684 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2
[junit4:junit4]   2> 4780 T1684 oass.SolrIndexSearcher.<init> Opening Searcher@6828f0f main
[junit4:junit4]   2> 4781 T1684 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 4781 T1684 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 4782 T1684 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 4787 T1684 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 4837 T1685 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6828f0f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 4842 T1684 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 4843 T1684 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5251 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5252 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1662_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1662/solr"}
[junit4:junit4]   2> 5253 T1676 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 5253 T1676 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5261 T1683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5262 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5847 T1684 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 5848 T1684 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1662/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 5854 T1684 oasc.ZkController.register We are http://127.0.0.1:1662/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 5854 T1684 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 5854 T1684 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 5855 T1684 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5857 T1684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5859 T1662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 5860 T1662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 5860 T1662 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 5860 T1662 oasc.CoreContainer.<init> New CoreContainer 248777258
[junit4:junit4]   2> 5861 T1662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 5861 T1662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 5888 T1662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 5889 T1662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 5889 T1662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 5890 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 5890 T1662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 5890 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 5891 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 5891 T1662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 5892 T1662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 5892 T1662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 5908 T1662 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 5929 T1662 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53051/solr
[junit4:junit4]   2> 5929 T1662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 5930 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@20fa6824
[junit4:junit4]   2> 5936 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5937 T1686 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5940 T1686 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 5940 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53058
[junit4:junit4]   2> 5941 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53058
[junit4:junit4]   2> 5942 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d810006 with negotiated timeout 20000 for client /127.0.0.1:53058
[junit4:junit4]   2> 5942 T1686 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d810006, negotiated timeout = 20000
[junit4:junit4]   2> 5943 T1687 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20fa6824 name:ZooKeeperConnection Watcher:127.0.0.1:53051 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5943 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5946 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d810006
[junit4:junit4]   2> 5947 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53058 which had sessionid 0x13bdfc76d810006
[junit4:junit4]   2> 5947 T1662 oaz.ZooKeeper.close Session: 0x13bdfc76d810006 closed
[junit4:junit4]   2> 5948 T1687 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5948 T1662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 5957 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@66d4f196
[junit4:junit4]   2> 5959 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 5959 T1688 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 5961 T1688 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 5961 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53059
[junit4:junit4]   2> 5962 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53059
[junit4:junit4]   2> 5963 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d810007 with negotiated timeout 3000 for client /127.0.0.1:53059
[junit4:junit4]   2> 5964 T1688 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d810007, negotiated timeout = 3000
[junit4:junit4]   2> 5964 T1689 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66d4f196 name:ZooKeeperConnection Watcher:127.0.0.1:53051/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 5964 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 5966 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810007 type:create cxid:0x1 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5968 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810007 type:create cxid:0x2 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 5970 T1662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 5971 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810007 type:delete cxid:0x4 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1663_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 5972 T1662 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 5982 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5984 T1683 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5985 T1683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 5988 T1675 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 5993 T1662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6003 T1690 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 6003 T1690 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6005 T1690 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6005 T1690 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6008 T1690 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 6009 T1690 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6009 T1690 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 6073 T1690 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 6181 T1690 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6183 T1690 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6193 T1690 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6277 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6279 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1662_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1662/solr"}
[junit4:junit4]   2> 6287 T1683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6289 T1689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6292 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7147 T1690 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7157 T1690 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7161 T1690 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7205 T1690 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7212 T1690 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7221 T1690 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7224 T1690 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7227 T1690 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/
[junit4:junit4]   2> 7228 T1690 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@767a9224
[junit4:junit4]   2> 7228 T1690 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 7229 T1690 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3 forceNew:false
[junit4:junit4]   2> 7229 T1690 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3
[junit4:junit4]   2> 7230 T1690 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index/
[junit4:junit4]   2> 7230 T1690 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7232 T1690 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index forceNew:false
[junit4:junit4]   2> 7234 T1690 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@53e0170c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4a3ece73)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7235 T1690 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 7235 T1690 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index
[junit4:junit4]   2> 7236 T1690 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7238 T1690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7239 T1690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7239 T1690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7240 T1690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7241 T1690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7241 T1690 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7242 T1690 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7242 T1690 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7242 T1690 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7243 T1690 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7244 T1690 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7244 T1690 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7245 T1690 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7245 T1690 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7245 T1690 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7246 T1690 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7247 T1690 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7247 T1690 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7248 T1690 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7249 T1690 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7249 T1690 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7250 T1690 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7250 T1690 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7251 T1690 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7251 T1690 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7252 T1690 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7258 T1690 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7264 T1690 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7266 T1690 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7270 T1690 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3
[junit4:junit4]   2> 7270 T1690 oass.SolrIndexSearcher.<init> Opening Searcher@43b2a1c7 main
[junit4:junit4]   2> 7271 T1690 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7272 T1690 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7273 T1690 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7281 T1690 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7325 T1691 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@43b2a1c7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7337 T1690 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7337 T1690 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7831 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7833 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
[junit4:junit4]   2> 7834 T1676 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 7834 T1676 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 7844 T1689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7844 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7846 T1683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8342 T1690 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 8343 T1690 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1663/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 8351 T1690 oasc.ZkController.register We are http://127.0.0.1:1663/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 8351 T1690 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 8352 T1690 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8352 T1690 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8356 T1690 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8359 T1662 oasc.ClusterStateUpdateTest.setUp ####SETUP_END testCoreRegistration
[junit4:junit4]   2> 8360 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8360 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b17a9d2
[junit4:junit4]   2> 8362 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
[junit4:junit4]   2> 8362 T1692 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8361 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8364 T1692 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 8365 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53060
[junit4:junit4]   2> 8366 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53060
[junit4:junit4]   2> 8367 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d810008 with negotiated timeout 10000 for client /127.0.0.1:53060
[junit4:junit4]   2> 8368 T1692 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d810008, negotiated timeout = 10000
[junit4:junit4]   2> 8369 T1693 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b17a9d2 name:ZooKeeperConnection Watcher:127.0.0.1:53051/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8369 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8370 T1662 oascc.SolrZkClient.makePath makePath: /collections/testcore
[junit4:junit4]   2> 8374 T1689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8375 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8376 T1683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8378 T1662 oascc.SolrZkClient.makePath makePath: /collections/testcore/shards
[junit4:junit4]   2> 8389 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d810008
[junit4:junit4]   2> 8391 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53060 which had sessionid 0x13bdfc76d810008
[junit4:junit4]   2> 8391 T1662 oaz.ZooKeeper.close Session: 0x13bdfc76d810008 closed
[junit4:junit4]   2> 8392 T1693 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8392 T1662 oasc.CoreContainer.create Creating SolrCore 'testcore' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore
[junit4:junit4]   2> 8395 T1662 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testcore
[junit4:junit4]   2> 8397 T1662 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 8398 T1662 oasc.ZkController.readConfigName Load collection config from:/collections/testcore
[junit4:junit4]   2> 8402 T1662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore/'
[junit4:junit4]   2> 8478 T1662 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 8603 T1662 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8606 T1662 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8617 T1662 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 9555 T1662 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9564 T1662 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9569 T1662 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9597 T1662 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9605 T1662 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9694 T1662 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9697 T1662 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9699 T1662 oasc.SolrCore.<init> [testcore] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4/
[junit4:junit4]   2> 9700 T1662 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@767a9224
[junit4:junit4]   2> 9700 T1662 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 9701 T1662 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4 forceNew:false
[junit4:junit4]   2> 9701 T1662 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4
[junit4:junit4]   2> 9701 T1662 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4/index/
[junit4:junit4]   2> 9702 T1662 oasc.SolrCore.initIndex WARNING [testcore] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9703 T1662 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4/index forceNew:false
[junit4:junit4]   2> 9705 T1662 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@39088d8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f19cbbb)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9706 T1662 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 9707 T1662 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4/index
[junit4:junit4]   2> 9707 T1662 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 9710 T1662 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9710 T1662 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 9711 T1662 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9712 T1662 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 9713 T1662 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9713 T1662 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9714 T1662 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9714 T1662 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9715 T1662 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9716 T1662 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 9716 T1662 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 9717 T1662 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9717 T1662 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 9718 T1662 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 9718 T1662 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 9719 T1662 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9719 T1662 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9720 T1662 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9721 T1662 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9721 T1662 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9722 T1662 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9722 T1662 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9723 T1662 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9724 T1662 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9724 T1662 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 9725 T1662 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 9730 T1662 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9734 T1662 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 9736 T1662 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 9738 T1662 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4
[junit4:junit4]   2> 9739 T1662 oass.SolrIndexSearcher.<init> Opening Searcher@74057363 main
[junit4:junit4]   2> 9740 T1662 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9740 T1662 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9741 T1662 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 9746 T1662 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 9795 T1694 oasc.SolrCore.registerSearcher [testcore] Registered new searcher Searcher@74057363 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9804 T1662 oasc.ZkController.publish publishing core=testcore state=down
[junit4:junit4]   2> 9805 T1662 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9899 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9901 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 9901 T1676 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9911 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9911 T1689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9912 T1683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10811 T1662 oasc.CoreContainer.registerCore registering core: testcore
[junit4:junit4]   2> 10811 T1662 oasc.ZkController.register Register replica - core:testcore address:http://127.0.0.1:1661/solr collection:testcore shard:shard1
[junit4:junit4]   2> 10813 T1662 oascc.SolrZkClient.makePath makePath: /collections/testcore/leader_elect/shard1/election
[junit4:junit4]   2> 10826 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:delete cxid:0x159 zxid:0x7c txntype:-1 reqpath:n/a Error Path:/solr/collections/testcore/leaders Error:KeeperErrorCode = NoNode for /solr/collections/testcore/leaders
[junit4:junit4]   2> 10828 T1662 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 10829 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x15a zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10832 T1662 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 10832 T1662 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 10832 T1662 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:1661/solr/testcore/
[junit4:junit4]   2> 10832 T1662 oascc.SolrZkClient.makePath makePath: /collections/testcore/leaders/shard1
[junit4:junit4]   2> 10841 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d810003 type:create cxid:0x164 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10931 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10947 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10947 T1689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10947 T1683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10998 T1662 oasc.ZkController.register We are http://127.0.0.1:1661/solr/testcore/ and leader is http://127.0.0.1:1661/solr/testcore/
[junit4:junit4]   2> 10999 T1662 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 10999 T1662 oasc.ZkController.publish publishing core=testcore state=active
[junit4:junit4]   2> 11000 T1662 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11003 T1662 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11005 T1662 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=248777258
[junit4:junit4]   2> 11006 T1662 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5f4b52a2
[junit4:junit4]   2> 11019 T1662 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 11020 T1662 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 11021 T1662 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 11021 T1662 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 11022 T1662 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 11023 T1662 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index
[junit4:junit4]   2> 11024 T1662 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index
[junit4:junit4]   2> 11024 T1662 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index
[junit4:junit4]   2> 11025 T1662 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3
[junit4:junit4]   2> 11025 T1662 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3
[junit4:junit4]   2> 11027 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d810007
[junit4:junit4]   2> 11028 T1689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11028 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53059 which had sessionid 0x13bdfc76d810007
[junit4:junit4]   2> 11029 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 11029 T1662 oaz.ZooKeeper.close Session: 0x13bdfc76d810007 closed
[junit4:junit4]   2> 11031 T1683 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 11032 T1683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 11033 T1675 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 11233 T1683 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11234 T1664 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13bdfc76d810005, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 11234 T1662 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=785540697
[junit4:junit4]   2> 11235 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53057 which had sessionid 0x13bdfc76d810005
[junit4:junit4]   2> 11235 T1662 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@30b94e61
[junit4:junit4]   2> 11236 T1662 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 11236 T1662 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 11236 T1662 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 11236 T1662 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 11237 T1662 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 11238 T1662 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2/index
[junit4:junit4]   2> 11238 T1662 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2
[junit4:junit4]   2> 11238 T1662 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2
[junit4:junit4]   2> 11238 T1662 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2/index
[junit4:junit4]   2> 11239 T1662 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data2/index
[junit4:junit4]   2> 11239 T1662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11240 T1662 oasc.SolrResourceLoader.locateSolrHome solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4:junit4]   2> 11240 T1662 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/solr/solr.xml
[junit4:junit4]   2> 11240 T1662 oasc.CoreContainer.<init> New CoreContainer 2041711158
[junit4:junit4]   2> 11240 T1662 oasc.CoreContainer$Initializer.initialize no solr.xml file found - using default
[junit4:junit4]   2> 11241 T1662 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'solr/'
[junit4:junit4]   2> 11241 T1662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'solr/'
[junit4:junit4]   2> 11260 T1662 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 11261 T1662 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11261 T1662 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 11261 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11262 T1662 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11262 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11262 T1662 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11263 T1662 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11263 T1662 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11263 T1662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 11277 T1662 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11299 T1662 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53051/solr
[junit4:junit4]   2> 11299 T1662 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11300 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6011c7cf
[junit4:junit4]   2> 11302 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11302 T1695 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11304 T1695 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 11304 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53061
[junit4:junit4]   2> 11305 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53061
[junit4:junit4]   2> 11307 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d810009 with negotiated timeout 20000 for client /127.0.0.1:53061
[junit4:junit4]   2> 11307 T1695 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d810009, negotiated timeout = 20000
[junit4:junit4]   2> 11308 T1696 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6011c7cf name:ZooKeeperConnection Watcher:127.0.0.1:53051 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11308 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11311 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d810009
[junit4:junit4]   2> 11312 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53061 which had sessionid 0x13bdfc76d810009
[junit4:junit4]   2> 11312 T1662 oaz.ZooKeeper.close Session: 0x13bdfc76d810009 closed
[junit4:junit4]   2> 11312 T1696 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11313 T1662 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=0&connTimeout=0
[junit4:junit4]   2> 12330 T1689 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 16493 T1662 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@65cd6782
[junit4:junit4]   2> 16493 T1674 oaz.ClientCnxn$SendThread.run Client session timed out, have not heard from server in 5460ms for sessionid 0x13bdfc76d810003, closing socket connection and attempting reconnect
[junit4:junit4]   2> 14914 T1665 oazs.ZooKeeperServer.expire Expiring session 0x13bdfc76d810003, timeout of 3000ms exceeded
[junit4:junit4]   2> 16495 T1664 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13bdfc76d810003, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 16494 T1689 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 16496 T1689 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16495 T1665 oazs.ZooKeeperServer.expire Expiring session 0x13bdfc76d810005, timeout of 3000ms exceeded
[junit4:junit4]   2> 16496 T1697 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 16499 T1662 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16500 T1697 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 16500 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53055 which had sessionid 0x13bdfc76d810003
[junit4:junit4]   2> 16499 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d810003
[junit4:junit4]   2> 16503 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53062
[junit4:junit4]   2> 16504 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53062
[junit4:junit4]   2> 16507 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d810005
[junit4:junit4]   2> 16509 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d81000a with negotiated timeout 3000 for client /127.0.0.1:53062
[junit4:junit4]   2> 16509 T1697 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d81000a, negotiated timeout = 3000
[junit4:junit4]   2> 16510 T1698 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65cd6782 name:ZooKeeperConnection Watcher:127.0.0.1:53051/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16510 T1662 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16511 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:create cxid:0x1 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16513 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:create cxid:0x2 zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16516 T1662 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 16517 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:delete cxid:0x4 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/192.168.57.17:8983_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 16518 T1662 oascc.SolrZkClient.makePath makePath: /live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 16531 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:delete cxid:0xd zxid:0x96 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 16533 T1662 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 16539 T1662 oasc.Overseer.start Overseer (id=88910665292513290-192.168.57.17:8983_solr-n_0000000003) starting
[junit4:junit4]   2> 16541 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:create cxid:0x12 zxid:0x98 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16543 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:create cxid:0x13 zxid:0x99 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16545 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:create cxid:0x14 zxid:0x9a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16547 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:create cxid:0x15 zxid:0x9b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16550 T1700 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 16551 T1662 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 16565 T1699 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 16569 T1699 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16571 T1699 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 16573 T1701 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: solr/collection1
[junit4:junit4]   2> 16573 T1701 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 16575 T1701 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 16575 T1701 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 16579 T1701 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'solr/collection1/'
[junit4:junit4]   2> 16584 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 16595 T1675 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1991c475 name:ZooKeeperConnection Watcher:127.0.0.1:53051/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 16596 T1675 oascc.ConnectionManager.process zkClient has disconnected
[junit4:junit4]   2> 16596 T1675 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Disconnected type None
[junit4:junit4]   2> 16670 T1701 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 16788 T1701 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 16790 T1701 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 16799 T1701 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 17808 T1701 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 17825 T1701 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 17832 T1701 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 17871 T1701 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17880 T1701 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17890 T1701 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17893 T1701 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17897 T1701 oasc.SolrCore.<init> [collection1] Opening new SolrCore at solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/
[junit4:junit4]   2> 17897 T1701 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@767a9224
[junit4:junit4]   2> 17898 T1701 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 17899 T1701 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3 forceNew:false
[junit4:junit4]   2> 17900 T1701 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3
[junit4:junit4]   2> 17900 T1701 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index/
[junit4:junit4]   2> 17901 T1701 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 17901 T1701 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index forceNew:false
[junit4:junit4]   2> 17904 T1701 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@270250a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2a53ba89)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17904 T1701 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17905 T1701 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index
[junit4:junit4]   2> 17906 T1701 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 17909 T1701 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 17910 T1701 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 17910 T1701 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 17911 T1701 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 17912 T1701 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 17912 T1701 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 17912 T1701 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 17913 T1701 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 17915 T1701 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 17916 T1701 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 17917 T1701 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 17917 T1701 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 17918 T1701 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 17918 T1701 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 17919 T1701 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 17919 T1701 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 17920 T1701 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17921 T1701 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17921 T1701 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17922 T1701 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17923 T1701 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17923 T1701 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17924 T1701 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17925 T1701 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17925 T1701 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 17926 T1701 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 17933 T1701 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 17939 T1701 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 17942 T1701 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 17947 T1701 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3
[junit4:junit4]   2> 17948 T1701 oass.SolrIndexSearcher.<init> Opening Searcher@60c3c35e main
[junit4:junit4]   2> 17949 T1701 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 17950 T1701 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 17951 T1701 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 17954 T1701 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 17974 T1702 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60c3c35e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 17981 T1701 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 17981 T1701 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18100 T1699 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18102 T1699 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"192.168.57.17:8983_solr",
[junit4:junit4]   2> 	  "base_url":"http://192.168.57.17:8983/solr"}
[junit4:junit4]   2> 18102 T1699 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 18103 T1699 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 18112 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 18597 T1674 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 18598 T1674 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 18599 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53063
[junit4:junit4]   2> 18600 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to renew session 0x13bdfc76d810003 at /127.0.0.1:53063
[junit4:junit4]   2> 18600 T1664 oazs.ZooKeeperServer.finishSessionInit Invalid session 0x13bdfc76d810003 for client /127.0.0.1:53063, probably expired
[junit4:junit4]   2> 18600 T1675 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1991c475 name:ZooKeeperConnection Watcher:127.0.0.1:53051/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4:junit4]   2> 18600 T1674 oaz.ClientCnxn$SendThread.run Unable to reconnect to ZooKeeper service, session 0x13bdfc76d810003 has expired, closing socket connection
[junit4:junit4]   2> 18601 T1675 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4:junit4]   2> 18600 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53063 which had sessionid 0x13bdfc76d810003
[junit4:junit4]   2> 18601 T1675 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4:junit4]   2> 18602 T1675 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53051/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@1991c475
[junit4:junit4]   2> 18603 T1675 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 18604 T1703 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:53051. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 18605 T1703 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:53051, initiating session
[junit4:junit4]   2> 18605 T1664 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:53064
[junit4:junit4]   2> 18607 T1664 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:53064
[junit4:junit4]   2> 18608 T1666 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdfc76d81000b with negotiated timeout 3000 for client /127.0.0.1:53064
[junit4:junit4]   2> 18609 T1703 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:53051, sessionid = 0x13bdfc76d81000b, negotiated timeout = 3000
[junit4:junit4]   2> 18612 T1704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1991c475 name:ZooKeeperConnection Watcher:127.0.0.1:53051/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 18613 T1675 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 18613 T1675 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4:junit4]   2> 18614 T1675 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 18614 T1675 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18624 T1699 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18625 T1699 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 18633 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 18703 T1676 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:200)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:123)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 18703 T1677 oasc.OverseerCollectionProcessor.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 18704 T1676 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88910665292513283-127.0.0.1:1661_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 18985 T1701 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 18986 T1701 oasc.ZkController.register Register replica - core:collection1 address:http://192.168.57.17:8983/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 18991 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:delete cxid:0x7d zxid:0xac txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 18992 T1701 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 18993 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:create cxid:0x7e zxid:0xad txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 18996 T1701 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=179999
[junit4:junit4]   2> 19144 T1699 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 19154 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 39119 T1701 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=159876
[junit4:junit4]   2> 48719 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 59257 T1701 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=139738
[junit4:junit4]   2> 79411 T1701 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=119584
[junit4:junit4]   2> 80818 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 99554 T1701 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=99441
[junit4:junit4]   2> 112891 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 119683 T1701 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=79312
[junit4:junit4]   2> 139854 T1701 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=59141
[junit4:junit4]   2> 144961 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 160040 T1701 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=38955
[junit4:junit4]   2> 177031 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 180188 T1701 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=18807
[junit4:junit4]   2> 199337 T1701 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Was waiting for replicas to come up, but they are taking too long - assuming they won't come back till later
[junit4:junit4]   2> 199337 T1701 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 199337 T1701 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://192.168.57.17:8983/solr/collection1/
[junit4:junit4]   2> 199337 T1701 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 199344 T1667 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdfc76d81000a type:create cxid:0x62a zxid:0xb4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 199643 T1699 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 199650 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 199709 T1701 oasc.ZkController.register We are http://192.168.57.17:8983/solr/collection1/ and leader is http://192.168.57.17:8983/solr/collection1/
[junit4:junit4]   2> 199709 T1701 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 199710 T1701 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 199710 T1701 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 199712 T1701 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 200090 T1675 oasc.ZkController.publish publishing core=testcore state=down
[junit4:junit4]   2> 200090 T1675 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 200159 T1699 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 200160 T1699 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"192.168.57.17:8983_solr",
[junit4:junit4]   2> 	  "base_url":"http://192.168.57.17:8983/solr"}
[junit4:junit4]   2> 200166 T1699 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 200172 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 220002 T1662 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1305632595
[junit4:junit4]   2> 220003 T1662 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7cb010b4
[junit4:junit4]   2> 220007 T1662 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 220007 T1662 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 220007 T1662 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 220008 T1662 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 220008 T1662 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 220009 T1662 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1/index
[junit4:junit4]   2> 220009 T1662 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1
[junit4:junit4]   2> 220010 T1662 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1
[junit4:junit4]   2> 220010 T1662 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1/index
[junit4:junit4]   2> 220010 T1662 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data1/index
[junit4:junit4]   2> 220011 T1662 oasc.SolrCore.close [testcore]  CLOSING SolrCore org.apache.solr.core.SolrCore@666ee19c
[junit4:junit4]   2> 220017 T1662 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 220018 T1662 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 220018 T1662 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 220019 T1662 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 220019 T1662 oasc.SolrCore.closeSearcher [testcore] Closing main searcher on request.
[junit4:junit4]   2> 220019 T1662 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4/index
[junit4:junit4]   2> 220020 T1662 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4
[junit4:junit4]   2> 220020 T1662 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4
[junit4:junit4]   2> 220020 T1662 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4/index
[junit4:junit4]   2> 220021 T1662 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data4/index
[junit4:junit4]   2> 220021 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d81000b
[junit4:junit4]   2> 220022 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53064 which had sessionid 0x13bdfc76d81000b
[junit4:junit4]   2> 220022 T1662 oaz.ZooKeeper.close Session: 0x13bdfc76d81000b closed
[junit4:junit4]   2> 220023 T1704 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 220023 T1662 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=2041711158
[junit4:junit4]   2> 220024 T1662 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2a23fe32
[junit4:junit4]   2> 220033 T1662 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 220033 T1662 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 220034 T1662 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 220034 T1662 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 220035 T1662 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 220035 T1662 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index
[junit4:junit4]   2> 220036 T1662 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3
[junit4:junit4]   2> 220036 T1662 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3
[junit4:junit4]   2> 220037 T1662 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index
[junit4:junit4]   2> 220037 T1662 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356669087096/data3/index
[junit4:junit4]   2> 220039 T1699 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88910665292513290-192.168.57.17:8983_solr-n_0000000003) am no longer a leader.
[junit4:junit4]   2> 220047 T1667 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdfc76d81000a
[junit4:junit4]   2> 220051 T1664 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:53062 which had sessionid 0x13bdfc76d81000a
[junit4:junit4]   2> 220051 T1662 oaz.ZooKeeper.close Session: 0x13bdfc76d81000a closed
[junit4:junit4]   2> 220052 T1698 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 220052 T1662 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=248777258
[junit4:junit4]   2> 220052 T1698 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 220053 T1662 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 220053 T1698 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 220053 T1662 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 220053 T1698 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 220053 T1662 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 220054 T1667 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 220054 T1662 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 220056 T1666 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 220056 T1662 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 220143 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 220270 T1662 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53051 53051
[junit4:junit4]   2> 220379 T1664 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 220383 T1662 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 220383 T1662 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 220384 T1662 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 220384 T1662 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 220384 T1662 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 220385 T1662 oas.SolrTestCaseJ4.tearDown ###Ending testCoreRegistration
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ClusterStateUpdateTest -Dtests.method=testCoreRegistration -Dtests.seed=CFAA6DC550223852 -Dtests.slow=true -Dtests.locale=el -Dtests.timezone=ART -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  220s | ClusterStateUpdateTest.testCoreRegistration <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([CFAA6DC550223852:71210B6A29583667]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:92)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:54)
[junit4:junit4]    > 	at org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterStateUpdateTest.java:234)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 220399 T1662 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 220435 T1661 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4]   2> 220912 T1665 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 223146 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 226149 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 229152 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 232155 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 235158 T1675 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 237160 T1675 oasc.SolrException.log SEVERE :org.apache.solr.common.SolrException: There was a problem finding the leader in zk
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1179)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 237163 T1675 oasc.SolrException.log SEVERE :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election/88910665292513291-127.0.0.1:1661_solr-n_
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:293)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:220)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:197)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 237164 T1675 oasc.SolrException.log SEVERE Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException: 
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:225)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election/88910665292513291-127.0.0.1:1661_solr-n_
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:293)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:220)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:197)
[junit4:junit4]   2> 		... 5 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 237165 T1675 oascc.DefaultConnectionStrategy.reconnect Reconnect to ZooKeeper failed
[junit4:junit4]   2> 237165 T1675 oascc.ConnectionManager.process Connected:true
[junit4:junit4]   2> 237166 T1675 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Expired type None
[junit4:junit4]   2> 237166 T1675 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=187)), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=el, timezone=ART
[junit4:junit4]   2> NOTE: Mac OS X 10.8.2 x86_64/Apple Inc. 1.6.0_37 (64-bit)/cpus=2,threads=1,free=38291968,total=142659584
[junit4:junit4]   2> NOTE: All tests run in this JVM: [BadComponentTest, PingRequestHandlerTest, PreAnalyzedFieldTest, TestXIncludeConfig, UniqFieldsUpdateProcessorFactoryTest, TestDocumentBuilder, IndexSchemaTest, PathHierarchyTokenizerFactoryTest, FastVectorHighlighterTest, TestSort, ExternalFileFieldSortTest, TestFaceting, SolrCmdDistributorTest, SuggesterTSTTest, TestAnalyzedSuggestions, TestHashPartitioner, UpdateParamsTest, TestLRUCache, TestUtils, SolrRequestParserTest, ResourceLoaderTest, TestStressReorder, SuggesterWFSTTest, TestAtomicUpdateErrorCases, StandardRequestHandlerTest, BasicZkTest, TestSolrQueryParser, TestCSVResponseWriter, TestQuerySenderListener, ZkControllerTest, ShardRoutingCustomTest, TestMultiCoreConfBootstrap, TestPluginEnable, TestUpdate, ZkSolrClientTest, DocumentAnalysisRequestHandlerTest, TestNumberUtils, CacheHeaderTest, DebugComponentTest, TestZkChroot, TestIndexingPerformance, StatsComponentTest, TestSolrIndexConfig, JsonLoaderTest, TestFiltering, UpdateRequestProcessorFactoryTest, BasicDistributedZkTest, TestStressRecovery, TestArbitraryIndexDir, TestValueSourceCache, TestFunctionQuery, CopyFieldTest, AnalysisAfterCoreReloadTest, TestBadConfig, DisMaxRequestHandlerTest, FileUtilsTest, TestCollationField, TestIndexSearcher, HighlighterConfigTest, LegacyHTMLStripCharFilterTest, AutoCommitTest, TestSurroundQueryParser, IndexBasedSpellCheckerTest, TestStressLucene, PrimUtilsTest, ShowFileRequestHandlerTest, TestSolrXMLSerializer, FieldMutatingUpdateProcessorTest, TestLMDirichletSimilarityFactory, ClusterStateTest, ChaosMonkeySafeLeaderTest, DirectSolrSpellCheckerTest, SearchHandlerTest, CircularListTest, SolrCoreTest, ResponseLogComponentTest, PrimitiveFieldTypeTest, SuggesterTest, SuggesterFSTTest, TestRemoteStreaming, TestFuzzyAnalyzedSuggestions, SchemaVersionSpecificBehaviorTest, SolrInfoMBeanTest, QueryParsingTest, SpellPossibilityIteratorTest, SyncSliceTest, IndexSchemaRuntimeFieldTest, TestDistributedSearch, SOLR749Test, PluginInfoTest, SystemInfoHandlerTest, TestDFRSimilarityFactory, TestConfig, ZkNodePropsTest, TestMergePolicyConfig, UUIDFieldTest, SortByFunctionTest, TestWordDelimiterFilterFactory, ClusterStateUpdateTest]
[junit4:junit4] Completed in 237.40s, 1 test, 1 failure <<< FAILURES!

[...truncated 418 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:353: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:178: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:438: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1176: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:841: There were test failures: 243 suites, 1009 tests, 1 failure, 13 ignored (2 assumptions)

Total time: 189 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.6.0 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 7 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/7/
Java: 64bit/jdk1.7.0 -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 230 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
	at __randomizedtesting.SeedInfo.seed([FF92153AB2384F90:7E749B22C5672FAC]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:175)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:125)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:120)
	at org.apache.solr.cloud.BasicDistributedZkTest.testCoreUnloadAndLeaders(BasicDistributedZkTest.java:586)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:337)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:794)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8915 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4:junit4]   2> 0 T1812 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4]   2> 8 T1812 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1356657306979
[junit4:junit4]   2> 10 T1812 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 11 T1813 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 13 T1813 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 13 T1813 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 13 T1813 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 14 T1813 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 15 T1813 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 112 T1812 oasc.ZkTestServer.run start zk server on port:51324
[junit4:junit4]   2> 113 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@23c6c2ca
[junit4:junit4]   2> 115 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 119 T1818 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 120 T1818 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 122 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51325
[junit4:junit4]   2> 123 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51325
[junit4:junit4]   2> 123 T1816 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 127 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a0000 with negotiated timeout 10000 for client /127.0.0.1:51325
[junit4:junit4]   2> 127 T1818 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a0000, negotiated timeout = 10000
[junit4:junit4]   2> 128 T1819 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23c6c2ca name:ZooKeeperConnection Watcher:127.0.0.1:51324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 129 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 129 T1812 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 135 T1817 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdf13ad6a0000
[junit4:junit4]   2> 137 T1819 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 137 T1812 oaz.ZooKeeper.close Session: 0x13bdf13ad6a0000 closed
[junit4:junit4]   2> 138 T1814 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51325 which had sessionid 0x13bdf13ad6a0000
[junit4:junit4]   2> 138 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@caed1c3
[junit4:junit4]   2> 139 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 140 T1820 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 141 T1820 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 141 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51326
[junit4:junit4]   2> 142 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51326
[junit4:junit4]   2> 143 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a0001 with negotiated timeout 10000 for client /127.0.0.1:51326
[junit4:junit4]   2> 143 T1820 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a0001, negotiated timeout = 10000
[junit4:junit4]   2> 144 T1821 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@caed1c3 name:ZooKeeperConnection Watcher:127.0.0.1:51324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 145 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 146 T1812 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 152 T1812 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 158 T1812 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 163 T1812 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 169 T1812 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 171 T1812 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 180 T1812 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 182 T1812 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 188 T1812 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 190 T1812 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 195 T1812 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 197 T1812 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 203 T1812 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 205 T1812 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 211 T1812 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 212 T1812 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 218 T1812 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 219 T1812 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 225 T1812 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 226 T1812 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 232 T1812 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 233 T1812 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 239 T1817 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdf13ad6a0001
[junit4:junit4]   2> 240 T1814 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51326 which had sessionid 0x13bdf13ad6a0001
[junit4:junit4]   2> 240 T1812 oaz.ZooKeeper.close Session: 0x13bdf13ad6a0001 closed
[junit4:junit4]   2> 241 T1821 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 501 T1812 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 517 T1812 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51327
[junit4:junit4]   2> 518 T1812 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 518 T1812 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211
[junit4:junit4]   2> 519 T1812 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211/'
[junit4:junit4]   2> 558 T1812 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 560 T1812 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 560 T1812 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211
[junit4:junit4]   2> 561 T1812 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211/solr.xml
[junit4:junit4]   2> 561 T1812 oasc.CoreContainer.<init> New CoreContainer 1584867619
[junit4:junit4]   2> 562 T1812 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211/'
[junit4:junit4]   2> 562 T1812 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211/'
[junit4:junit4]   2> 601 T1812 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 602 T1812 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 603 T1812 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 603 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 606 T1812 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 609 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 610 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 610 T1812 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 610 T1812 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 611 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 638 T1812 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 686 T1812 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:51324/solr
[junit4:junit4]   2> 688 T1812 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 689 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@689c8f1
[junit4:junit4]   2> 691 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 692 T1831 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 694 T1831 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 696 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51328
[junit4:junit4]   2> 697 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51328
[junit4:junit4]   2> 698 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a0002 with negotiated timeout 20000 for client /127.0.0.1:51328
[junit4:junit4]   2> 698 T1831 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a0002, negotiated timeout = 20000
[junit4:junit4]   2> 699 T1832 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@689c8f1 name:ZooKeeperConnection Watcher:127.0.0.1:51324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 700 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 703 T1817 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdf13ad6a0002
[junit4:junit4]   2> 705 T1814 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51328 which had sessionid 0x13bdf13ad6a0002
[junit4:junit4]   2> 705 T1812 oaz.ZooKeeper.close Session: 0x13bdf13ad6a0002 closed
[junit4:junit4]   2> 706 T1832 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 706 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 715 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@19564d7e
[junit4:junit4]   2> 717 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 717 T1833 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 718 T1833 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 719 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51329
[junit4:junit4]   2> 720 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51329
[junit4:junit4]   2> 721 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a0003 with negotiated timeout 20000 for client /127.0.0.1:51329
[junit4:junit4]   2> 722 T1833 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a0003, negotiated timeout = 20000
[junit4:junit4]   2> 722 T1834 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19564d7e name:ZooKeeperConnection Watcher:127.0.0.1:51324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 723 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 728 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 731 T1812 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 736 T1812 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51327_
[junit4:junit4]   2> 738 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51327_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51327_
[junit4:junit4]   2> 740 T1812 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51327_
[junit4:junit4]   2> 752 T1812 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 768 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 772 T1812 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 779 T1812 oasc.Overseer.start Overseer (id=88909893270634499-127.0.0.1:51327_-n_0000000000) starting
[junit4:junit4]   2> 783 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 786 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 788 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 792 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 797 T1836 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 801 T1812 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 812 T1812 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 832 T1835 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 836 T1837 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211/collection1
[junit4:junit4]   2> 836 T1837 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4]   2> 838 T1837 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 838 T1837 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4]   2> 848 T1837 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211/collection1/'
[junit4:junit4]   2> 850 T1837 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 851 T1837 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211/collection1/lib/README' to classloader
[junit4:junit4]   2> 943 T1837 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 1045 T1837 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 1049 T1837 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 1059 T1837 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 1706 T1837 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 1715 T1837 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 1719 T1837 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 1746 T1837 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1753 T1837 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 1759 T1837 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1762 T1837 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 1765 T1837 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1356657307211/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/control/data/
[junit4:junit4]   2> 1766 T1837 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3479501a
[junit4:junit4]   2> 1766 T1837 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 1768 T1837 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/control/data forceNew:false
[junit4:junit4]   2> 1770 T1837 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/control/data
[junit4:junit4]   2> 1770 T1837 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/control/data/index/
[junit4:junit4]   2> 1771 T1837 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 1774 T1837 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/control/data/index forceNew:false
[junit4:junit4]   2> 1789 T1837 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3cc94600; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 1790 T1837 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 1794 T1837 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/control/data/index
[junit4:junit4]   2> 1795 T1837 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 1801 T1837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 1802 T1837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 1803 T1837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 1805 T1837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 1806 T1837 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 1807 T1837 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 1809 T1837 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 1809 T1837 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 1810 T1837 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 1811 T1837 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 1814 T1837 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 1815 T1837 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 1815 T1837 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 1816 T1837 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 1817 T1837 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 1817 T1837 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 1818 T1837 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1819 T1837 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1820 T1837 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1822 T1837 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1822 T1837 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1823 T1837 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1824 T1837 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1825 T1837 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 1826 T1837 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 1826 T1837 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 1838 T1837 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 1844 T1837 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 1847 T1837 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 1851 T1837 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/control/data
[junit4:junit4]   2> 1855 T1837 oass.SolrIndexSearcher.<init> Opening Searcher@37fd593f main
[junit4:junit4]   2> 1857 T1837 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 1857 T1837 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 1858 T1837 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 1868 T1837 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 1926 T1838 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@37fd593f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 1939 T1837 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 1940 T1837 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 1941 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:create cxid:0x56 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 2367 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 2369 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51327_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51327"}
[junit4:junit4]   2> 2369 T1835 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4]   2> 2369 T1835 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 2370 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:create cxid:0x5e zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 2380 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 2950 T1837 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 2950 T1837 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51327 collection:control_collection shard:shard1
[junit4:junit4]   2> 2951 T1837 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   2> 2963 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:delete cxid:0x7b zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4]   2> 2964 T1837 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 2965 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:create cxid:0x7c zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2968 T1837 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 2969 T1837 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 2969 T1837 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51327/collection1/
[junit4:junit4]   2> 2969 T1837 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 2969 T1837 oasc.SyncStrategy.syncToMe http://127.0.0.1:51327/collection1/ has no replicas
[junit4:junit4]   2> 2969 T1837 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51327/collection1/
[junit4:junit4]   2> 2969 T1837 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   2> 2976 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0003 type:create cxid:0x86 zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3392 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3406 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3446 T1837 oasc.ZkController.register We are http://127.0.0.1:51327/collection1/ and leader is http://127.0.0.1:51327/collection1/
[junit4:junit4]   2> 3447 T1837 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51327
[junit4:junit4]   2> 3447 T1837 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 3447 T1837 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 3448 T1837 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3451 T1837 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3453 T1812 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 3454 T1812 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 3454 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 3462 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4]   2> 3470 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@8566358
[junit4:junit4]   2> 3471 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3472 T1839 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3473 T1839 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 3474 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51330
[junit4:junit4]   2> 3475 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51330
[junit4:junit4]   2> 3477 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a0004 with negotiated timeout 10000 for client /127.0.0.1:51330
[junit4:junit4]   2> 3477 T1839 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a0004, negotiated timeout = 10000
[junit4:junit4]   2> 3478 T1840 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8566358 name:ZooKeeperConnection Watcher:127.0.0.1:51324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3478 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 3480 T1812 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 3483 T1812 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   2> 3788 T1812 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 3810 T1812 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51331
[junit4:junit4]   2> 3816 T1812 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3816 T1812 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454
[junit4:junit4]   2> 3818 T1812 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454/'
[junit4:junit4]   2> 3867 T1812 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 3868 T1812 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 3869 T1812 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454
[junit4:junit4]   2> 3870 T1812 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454/solr.xml
[junit4:junit4]   2> 3871 T1812 oasc.CoreContainer.<init> New CoreContainer 336484140
[junit4:junit4]   2> 3873 T1812 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454/'
[junit4:junit4]   2> 3874 T1812 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454/'
[junit4:junit4]   2> 3918 T1812 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 3919 T1812 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 3919 T1812 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 3920 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 3920 T1812 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 3921 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 3921 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 3922 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3922 T1812 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 3923 T1812 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 3924 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"control_collection",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51327_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51327"}
[junit4:junit4]   2> 3924 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 3932 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3933 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 3953 T1812 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 3981 T1812 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:51324/solr
[junit4:junit4]   2> 3982 T1812 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 3983 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@488d7c59
[junit4:junit4]   2> 3985 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 3985 T1850 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 3988 T1850 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 3993 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51332
[junit4:junit4]   2> 3994 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51332
[junit4:junit4]   2> 3996 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a0005 with negotiated timeout 20000 for client /127.0.0.1:51332
[junit4:junit4]   2> 3996 T1850 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a0005, negotiated timeout = 20000
[junit4:junit4]   2> 3997 T1851 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@488d7c59 name:ZooKeeperConnection Watcher:127.0.0.1:51324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 3998 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4001 T1817 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdf13ad6a0005
[junit4:junit4]   2> 4003 T1814 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51332 which had sessionid 0x13bdf13ad6a0005
[junit4:junit4]   2> 4006 T1851 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4006 T1812 oaz.ZooKeeper.close Session: 0x13bdf13ad6a0005 closed
[junit4:junit4]   2> 4008 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 4020 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6a4fa541
[junit4:junit4]   2> 4025 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4025 T1852 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 4026 T1852 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 4027 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51333
[junit4:junit4]   2> 4028 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51333
[junit4:junit4]   2> 4030 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a0006 with negotiated timeout 20000 for client /127.0.0.1:51333
[junit4:junit4]   2> 4030 T1852 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a0006, negotiated timeout = 20000
[junit4:junit4]   2> 4031 T1853 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a4fa541 name:ZooKeeperConnection Watcher:127.0.0.1:51324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4032 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4033 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0006 type:create cxid:0x1 zxid:0x4d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4035 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0006 type:create cxid:0x2 zxid:0x4e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4039 T1812 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51331_
[junit4:junit4]   2> 4040 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0006 type:delete cxid:0x4 zxid:0x4f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51331_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51331_
[junit4:junit4]   2> 4041 T1812 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51331_
[junit4:junit4]   2> 4051 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4053 T1834 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4053 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4055 T1840 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4064 T1812 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4081 T1854 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454/collection1
[junit4:junit4]   2> 4081 T1854 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4083 T1854 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4083 T1854 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4091 T1854 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454/collection1/'
[junit4:junit4]   2> 4092 T1854 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4092 T1854 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454/collection1/lib/README' to classloader
[junit4:junit4]   2> 4173 T1854 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 4272 T1854 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4274 T1854 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4280 T1854 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 5076 T1854 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5091 T1854 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5097 T1854 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5129 T1854 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5135 T1854 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5142 T1854 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5146 T1854 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5150 T1854 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1356657310454/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1/
[junit4:junit4]   2> 5150 T1854 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3479501a
[junit4:junit4]   2> 5151 T1854 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 5153 T1854 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1 forceNew:false
[junit4:junit4]   2> 5154 T1854 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1
[junit4:junit4]   2> 5154 T1854 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1/index/
[junit4:junit4]   2> 5155 T1854 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5156 T1854 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1/index forceNew:false
[junit4:junit4]   2> 5161 T1854 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@284c3768; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5162 T1854 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5163 T1854 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1/index
[junit4:junit4]   2> 5164 T1854 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5166 T1854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5167 T1854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5167 T1854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5167 T1854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5168 T1854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5169 T1854 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5169 T1854 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5170 T1854 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5170 T1854 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5171 T1854 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5172 T1854 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5172 T1854 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5173 T1854 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5173 T1854 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5174 T1854 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5174 T1854 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5175 T1854 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5175 T1854 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5176 T1854 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5177 T1854 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5177 T1854 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5178 T1854 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5178 T1854 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5179 T1854 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5180 T1854 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5180 T1854 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5188 T1854 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5193 T1854 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5195 T1854 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5197 T1854 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1
[junit4:junit4]   2> 5199 T1854 oass.SolrIndexSearcher.<init> Opening Searcher@5e834b46 main
[junit4:junit4]   2> 5201 T1854 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5201 T1854 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5202 T1854 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5209 T1854 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5243 T1855 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5e834b46 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5249 T1854 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5250 T1854 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5457 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5458 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51331_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51331"}
[junit4:junit4]   2> 5459 T1835 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4]   2> 5459 T1835 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5466 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5466 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5466 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6253 T1854 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6253 T1854 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51331 collection:collection1 shard:shard1
[junit4:junit4]   2> 6254 T1854 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 6273 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0006 type:delete cxid:0x43 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 6275 T1854 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 6276 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0006 type:create cxid:0x44 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6279 T1854 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 6279 T1854 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 6280 T1854 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51331/collection1/
[junit4:junit4]   2> 6280 T1854 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 6280 T1854 oasc.SyncStrategy.syncToMe http://127.0.0.1:51331/collection1/ has no replicas
[junit4:junit4]   2> 6280 T1854 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51331/collection1/
[junit4:junit4]   2> 6281 T1854 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 6287 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0006 type:create cxid:0x4e zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6481 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6494 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6494 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6494 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6549 T1854 oasc.ZkController.register We are http://127.0.0.1:51331/collection1/ and leader is http://127.0.0.1:51331/collection1/
[junit4:junit4]   2> 6550 T1854 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51331
[junit4:junit4]   2> 6550 T1854 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 6550 T1854 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6551 T1854 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6554 T1854 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6556 T1812 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 6557 T1812 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 6557 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 6906 T1812 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 6911 T1812 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51334
[junit4:junit4]   2> 6912 T1812 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6913 T1812 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536
[junit4:junit4]   2> 6913 T1812 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536/'
[junit4:junit4]   2> 6962 T1812 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 6963 T1812 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6964 T1812 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536
[junit4:junit4]   2> 6965 T1812 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536/solr.xml
[junit4:junit4]   2> 6966 T1812 oasc.CoreContainer.<init> New CoreContainer 1711923203
[junit4:junit4]   2> 6967 T1812 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536/'
[junit4:junit4]   2> 6968 T1812 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536/'
[junit4:junit4]   2> 6999 T1812 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 7000 T1812 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 7001 T1812 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 7001 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 7002 T1812 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 7003 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 7004 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 7006 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7005 T1812 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 7007 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51331_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51331"}
[junit4:junit4]   2> 7007 T1812 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 7009 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 7020 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7020 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7020 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7039 T1812 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 7060 T1812 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:51324/solr
[junit4:junit4]   2> 7061 T1812 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 7061 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c45ba82
[junit4:junit4]   2> 7063 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7064 T1865 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7066 T1865 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 7067 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51335
[junit4:junit4]   2> 7068 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51335
[junit4:junit4]   2> 7069 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a0007 with negotiated timeout 20000 for client /127.0.0.1:51335
[junit4:junit4]   2> 7070 T1865 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a0007, negotiated timeout = 20000
[junit4:junit4]   2> 7070 T1866 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c45ba82 name:ZooKeeperConnection Watcher:127.0.0.1:51324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7072 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7075 T1817 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdf13ad6a0007
[junit4:junit4]   2> 7076 T1814 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51335 which had sessionid 0x13bdf13ad6a0007
[junit4:junit4]   2> 7077 T1812 oaz.ZooKeeper.close Session: 0x13bdf13ad6a0007 closed
[junit4:junit4]   2> 7077 T1866 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7077 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 7086 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3690157f
[junit4:junit4]   2> 7091 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7092 T1867 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 7093 T1867 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 7094 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51336
[junit4:junit4]   2> 7095 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51336
[junit4:junit4]   2> 7096 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a0008 with negotiated timeout 20000 for client /127.0.0.1:51336
[junit4:junit4]   2> 7097 T1867 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a0008, negotiated timeout = 20000
[junit4:junit4]   2> 7097 T1868 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3690157f name:ZooKeeperConnection Watcher:127.0.0.1:51324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7099 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7101 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0008 type:create cxid:0x1 zxid:0x71 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7103 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0008 type:create cxid:0x2 zxid:0x72 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7108 T1812 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51334_
[junit4:junit4]   2> 7110 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0008 type:delete cxid:0x4 zxid:0x73 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51334_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51334_
[junit4:junit4]   2> 7112 T1812 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51334_
[junit4:junit4]   2> 7121 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7122 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 7127 T1853 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7128 T1840 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7128 T1834 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 7129 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7140 T1812 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7158 T1869 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536/collection1
[junit4:junit4]   2> 7159 T1869 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 7162 T1869 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 7162 T1869 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 7169 T1869 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536/collection1/'
[junit4:junit4]   2> 7170 T1869 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 7171 T1869 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536/collection1/lib/README' to classloader
[junit4:junit4]   2> 7245 T1869 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 7319 T1869 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 7322 T1869 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 7331 T1869 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8013 T1869 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 8021 T1869 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 8025 T1869 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 8057 T1869 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8064 T1869 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 8070 T1869 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8072 T1869 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 8074 T1869 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1356657313536/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2/
[junit4:junit4]   2> 8075 T1869 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3479501a
[junit4:junit4]   2> 8075 T1869 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 8076 T1869 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2 forceNew:false
[junit4:junit4]   2> 8077 T1869 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2
[junit4:junit4]   2> 8077 T1869 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2/index/
[junit4:junit4]   2> 8077 T1869 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 8079 T1869 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2/index forceNew:false
[junit4:junit4]   2> 8084 T1869 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d4fab1b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 8084 T1869 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 8085 T1869 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2/index
[junit4:junit4]   2> 8085 T1869 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 8088 T1869 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 8089 T1869 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 8089 T1869 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 8089 T1869 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 8090 T1869 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 8090 T1869 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 8091 T1869 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 8092 T1869 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 8092 T1869 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 8093 T1869 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 8094 T1869 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 8094 T1869 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 8095 T1869 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 8095 T1869 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 8095 T1869 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 8096 T1869 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 8096 T1869 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8097 T1869 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8097 T1869 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8098 T1869 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8098 T1869 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8099 T1869 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8099 T1869 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8100 T1869 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 8101 T1869 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 8101 T1869 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 8110 T1869 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 8113 T1869 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 8114 T1869 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 8116 T1869 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2
[junit4:junit4]   2> 8118 T1869 oass.SolrIndexSearcher.<init> Opening Searcher@1fef9298 main
[junit4:junit4]   2> 8119 T1869 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 8119 T1869 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 8120 T1869 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 8125 T1869 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 8160 T1870 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1fef9298 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 8165 T1869 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 8165 T1869 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8537 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8539 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51334_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51334"}
[junit4:junit4]   2> 8539 T1835 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 8539 T1835 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 8546 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8546 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8546 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8546 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9169 T1869 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 9170 T1869 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51334 collection:collection1 shard:shard2
[junit4:junit4]   2> 9171 T1869 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 9182 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0008 type:delete cxid:0x42 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 9183 T1869 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 9184 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0008 type:create cxid:0x43 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9187 T1869 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 9187 T1869 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 9188 T1869 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51334/collection1/
[junit4:junit4]   2> 9188 T1869 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4]   2> 9188 T1869 oasc.SyncStrategy.syncToMe http://127.0.0.1:51334/collection1/ has no replicas
[junit4:junit4]   2> 9189 T1869 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51334/collection1/
[junit4:junit4]   2> 9189 T1869 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 9196 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a0008 type:create cxid:0x4c zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 9564 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9576 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9576 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9576 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9576 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9617 T1869 oasc.ZkController.register We are http://127.0.0.1:51334/collection1/ and leader is http://127.0.0.1:51334/collection1/
[junit4:junit4]   2> 9617 T1869 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51334
[junit4:junit4]   2> 9618 T1869 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4]   2> 9618 T1869 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 9618 T1869 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9621 T1869 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9623 T1812 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 9624 T1812 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 9624 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 9835 T1812 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 9854 T1812 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51337
[junit4:junit4]   2> 9855 T1812 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9855 T1812 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602
[junit4:junit4]   2> 9856 T1812 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602/'
[junit4:junit4]   2> 9889 T1812 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 9890 T1812 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 9891 T1812 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602
[junit4:junit4]   2> 9892 T1812 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602/solr.xml
[junit4:junit4]   2> 9893 T1812 oasc.CoreContainer.<init> New CoreContainer 1189222109
[junit4:junit4]   2> 9894 T1812 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602/'
[junit4:junit4]   2> 9895 T1812 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602/'
[junit4:junit4]   2> 9936 T1812 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 9937 T1812 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 9938 T1812 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 9939 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 9940 T1812 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 9941 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 9942 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 9943 T1812 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 9945 T1812 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 9946 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 9968 T1812 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 9984 T1812 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:51324/solr
[junit4:junit4]   2> 9984 T1812 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 9985 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ee952d2
[junit4:junit4]   2> 9986 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 9986 T1880 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 9988 T1880 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 9989 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51338
[junit4:junit4]   2> 9989 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51338
[junit4:junit4]   2> 9991 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a0009 with negotiated timeout 20000 for client /127.0.0.1:51338
[junit4:junit4]   2> 9991 T1880 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a0009, negotiated timeout = 20000
[junit4:junit4]   2> 9991 T1881 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ee952d2 name:ZooKeeperConnection Watcher:127.0.0.1:51324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 9992 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 9994 T1817 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdf13ad6a0009
[junit4:junit4]   2> 9995 T1814 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51338 which had sessionid 0x13bdf13ad6a0009
[junit4:junit4]   2> 9995 T1812 oaz.ZooKeeper.close Session: 0x13bdf13ad6a0009 closed
[junit4:junit4]   2> 9995 T1881 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9996 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 10001 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3f9ca358
[junit4:junit4]   2> 10002 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 10003 T1882 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 10004 T1882 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 10005 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51339
[junit4:junit4]   2> 10005 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51339
[junit4:junit4]   2> 10007 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a000a with negotiated timeout 20000 for client /127.0.0.1:51339
[junit4:junit4]   2> 10007 T1882 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a000a, negotiated timeout = 20000
[junit4:junit4]   2> 10007 T1883 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f9ca358 name:ZooKeeperConnection Watcher:127.0.0.1:51324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 10008 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 10009 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10011 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10014 T1812 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51337_
[junit4:junit4]   2> 10015 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a000a type:delete cxid:0x4 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51337_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51337_
[junit4:junit4]   2> 10016 T1812 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51337_
[junit4:junit4]   2> 10020 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10020 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10020 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10022 T1834 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 10022 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10026 T1853 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 10027 T1840 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 10027 T1868 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 10030 T1812 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 10042 T1884 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602/collection1
[junit4:junit4]   2> 10042 T1884 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 10043 T1884 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 10043 T1884 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 10045 T1884 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602/collection1/'
[junit4:junit4]   2> 10047 T1884 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 10048 T1884 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602/collection1/lib/README' to classloader
[junit4:junit4]   2> 10087 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10088 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51334_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51334"}
[junit4:junit4]   2> 10096 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10096 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10097 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10098 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10099 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 10101 T1884 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 10184 T1884 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 10186 T1884 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 10193 T1884 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 10902 T1884 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 10908 T1884 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 10910 T1884 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 10929 T1884 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10934 T1884 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 10938 T1884 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10940 T1884 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 10942 T1884 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1356657316602/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/
[junit4:junit4]   2> 10942 T1884 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3479501a
[junit4:junit4]   2> 10943 T1884 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 10943 T1884 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3 forceNew:false
[junit4:junit4]   2> 10944 T1884 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3
[junit4:junit4]   2> 10944 T1884 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index/
[junit4:junit4]   2> 10944 T1884 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 10946 T1884 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index forceNew:false
[junit4:junit4]   2> 10950 T1884 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4c282efa; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 10951 T1884 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 10952 T1884 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index
[junit4:junit4]   2> 10952 T1884 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 10954 T1884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 10955 T1884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 10955 T1884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 10956 T1884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 10956 T1884 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 10957 T1884 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 10957 T1884 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 10958 T1884 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 10959 T1884 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 10959 T1884 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 10960 T1884 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 10960 T1884 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 10961 T1884 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 10961 T1884 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 10962 T1884 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 10962 T1884 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 10963 T1884 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10963 T1884 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10964 T1884 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10964 T1884 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10965 T1884 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10965 T1884 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10966 T1884 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10966 T1884 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 10967 T1884 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 10968 T1884 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 10974 T1884 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 10977 T1884 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 10979 T1884 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 10982 T1884 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3
[junit4:junit4]   2> 10983 T1884 oass.SolrIndexSearcher.<init> Opening Searcher@7fda935f main
[junit4:junit4]   2> 10984 T1884 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 10985 T1884 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 10986 T1884 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 10996 T1884 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 11042 T1885 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7fda935f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 11048 T1884 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 11049 T1884 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 11112 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11114 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51337_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51337"}
[junit4:junit4]   2> 11114 T1835 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 11114 T1835 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 11120 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11120 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11120 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11120 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 11121 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12055 T1884 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 12056 T1884 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51337 collection:collection1 shard:shard1
[junit4:junit4]   2> 12067 T1884 oasc.ZkController.register We are http://127.0.0.1:51337/collection1/ and leader is http://127.0.0.1:51331/collection1/
[junit4:junit4]   2> 12068 T1884 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51337
[junit4:junit4]   2> 12069 T1884 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 12070 T1884 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C103 name=collection1 org.apache.solr.core.SolrCore@e5b76cc url=http://127.0.0.1:51337/collection1 node=127.0.0.1:51337_ C103_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:51337_, base_url=http://127.0.0.1:51337}
[junit4:junit4]   2> 12073 T1886 C103 P51337 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 12074 T1884 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12075 T1886 C103 P51337 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 12076 T1886 C103 P51337 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 12077 T1886 C103 P51337 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 12078 T1812 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 12080 T1812 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 12080 T1886 C103 P51337 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12081 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 12133 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12134 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51337_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51337"}
[junit4:junit4]   2> 12140 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12140 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12141 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12144 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12144 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12289 T1812 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4]   2> 12292 T1812 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51341
[junit4:junit4]   2> 12297 T1812 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12297 T1812 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067
[junit4:junit4]   2> 12298 T1812 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067/'
[junit4:junit4]   2> 12332 T1812 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4]   2> 12333 T1812 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 12333 T1812 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067
[junit4:junit4]   2> 12334 T1812 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067/solr.xml
[junit4:junit4]   2> 12334 T1812 oasc.CoreContainer.<init> New CoreContainer 1456620153
[junit4:junit4]   2> 12335 T1812 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067/'
[junit4:junit4]   2> 12336 T1812 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067/'
[junit4:junit4]   2> 12364 T1812 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 12365 T1812 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 12365 T1812 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 12366 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 12366 T1812 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 12367 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 12367 T1812 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 12368 T1812 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 12369 T1812 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 12369 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 12384 T1812 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 12402 T1812 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:51324/solr
[junit4:junit4]   2> 12404 T1812 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 12405 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@169e3d1e
[junit4:junit4]   2> 12406 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12407 T1896 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12409 T1896 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 12409 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51342
[junit4:junit4]   2> 12410 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51342
[junit4:junit4]   2> 12411 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a000b with negotiated timeout 20000 for client /127.0.0.1:51342
[junit4:junit4]   2> 12411 T1896 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a000b, negotiated timeout = 20000
[junit4:junit4]   2> 12412 T1897 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@169e3d1e name:ZooKeeperConnection Watcher:127.0.0.1:51324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12412 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12414 T1817 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bdf13ad6a000b
[junit4:junit4]   2> 12415 T1814 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:51342 which had sessionid 0x13bdf13ad6a000b
[junit4:junit4]   2> 12415 T1812 oaz.ZooKeeper.close Session: 0x13bdf13ad6a000b closed
[junit4:junit4]   2> 12416 T1897 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 12416 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 12422 T1812 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:51324/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@697eab5e
[junit4:junit4]   2> 12424 T1812 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 12424 T1898 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:51324. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4]   2> 12425 T1898 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:51324, initiating session
[junit4:junit4]   2> 12426 T1814 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:51343
[junit4:junit4]   2> 12427 T1814 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:51343
[junit4:junit4]   2> 12428 T1816 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bdf13ad6a000c with negotiated timeout 20000 for client /127.0.0.1:51343
[junit4:junit4]   2> 12428 T1898 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:51324, sessionid = 0x13bdf13ad6a000c, negotiated timeout = 20000
[junit4:junit4]   2> 12429 T1899 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@697eab5e name:ZooKeeperConnection Watcher:127.0.0.1:51324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 12429 T1812 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 12430 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a000c type:create cxid:0x1 zxid:0xa6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12432 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a000c type:create cxid:0x2 zxid:0xa7 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12434 T1812 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51341_
[junit4:junit4]   2> 12435 T1817 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bdf13ad6a000c type:delete cxid:0x4 zxid:0xa8 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51341_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51341_
[junit4:junit4]   2> 12436 T1812 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51341_
[junit4:junit4]   2> 12440 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12441 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12441 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12441 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   2> 12443 T1834 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12444 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 12447 T1853 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12448 T1868 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12449 T1840 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12449 T1883 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 12453 T1812 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 12462 T1900 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067/collection1
[junit4:junit4]   2> 12462 T1900 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 12463 T1900 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 12464 T1900 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 12466 T1900 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067/collection1/'
[junit4:junit4]   2> 12467 T1900 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 12467 T1900 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067/collection1/lib/README' to classloader
[junit4:junit4]   2> 12521 T1900 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 12586 T1900 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 12587 T1900 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 12592 T1900 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 13209 T1900 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 13218 T1900 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 13222 T1900 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 13253 T1900 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13262 T1900 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 13273 T1900 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13275 T1900 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 13276 T1900 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty4-1356657319067/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/
[junit4:junit4]   2> 13277 T1900 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3479501a
[junit4:junit4]   2> 13281 T1900 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4]   2> 13282 T1900 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4 forceNew:false
[junit4:junit4]   2> 13282 T1900 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4
[junit4:junit4]   2> 13283 T1900 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index/
[junit4:junit4]   2> 13283 T1900 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 13285 T1900 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index forceNew:false
[junit4:junit4]   2> 13292 T1900 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@13b8f4cb; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 13292 T1900 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 13294 T1900 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index
[junit4:junit4]   2> 13294 T1900 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 13299 T1900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 13300 T1900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 13300 T1900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 13301 T1900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 13302 T1900 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 13302 T1900 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 13302 T1900 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 13303 T1900 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 13303 T1900 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 13304 T1900 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 13305 T1900 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 13305 T1900 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 13306 T1900 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 13306 T1900 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 13307 T1900 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 13307 T1900 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 13308 T1900 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13308 T1900 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13309 T1900 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13309 T1900 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13310 T1900 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13310 T1900 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13311 T1900 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13312 T1900 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 13312 T1900 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 13313 T1900 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 13319 T1900 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 13322 T1900 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 13325 T1900 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 13330 T1900 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4
[junit4:junit4]   2> 13333 T1900 oass.SolrIndexSearcher.<init> Opening Searcher@cafef7c main
[junit4:junit4]   2> 13334 T1900 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 13335 T1900 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 13335 T1900 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 13343 T1900 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 13384 T1901 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cafef7c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 13392 T1900 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 13392 T1900 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 13681 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13684 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51341_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51341"}
[junit4:junit4]   2> 13685 T1835 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4]   2> 13685 T1835 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4]   2> 13706 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13707 T1899 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13708 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13707 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13710 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 13709 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14395 T1900 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 14396 T1900 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51341 collection:collection1 shard:shard2
[junit4:junit4]   2> 14400 T1900 oasc.ZkController.register We are http://127.0.0.1:51341/collection1/ and leader is http://127.0.0.1:51334/collection1/
[junit4:junit4]   2> 14401 T1900 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51341
[junit4:junit4]   2> 14401 T1900 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4]   2> 14401 T1900 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4]   2> ASYNC  NEW_CORE C104 name=collection1 org.apache.solr.core.SolrCore@3aa60827 url=http://127.0.0.1:51341/collection1 node=127.0.0.1:51341_ C104_STATE=coll:collection1 core:collection1 props:{shard=null, roles=null, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:51341_, base_url=http://127.0.0.1:51341}
[junit4:junit4]   2> 14402 T1902 C104 P51341 oasc.RecoveryStrategy.run Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   2> 14402 T1900 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14403 T1902 C104 P51341 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4]   2> 14404 T1902 C104 P51341 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4]   2> 14404 T1902 C104 P51341 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 14405 T1812 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4]   2> 14406 T1812 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4]   2> 14406 T1902 C104 P51341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14406 T1812 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> 14421 T1812 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14422 T1812 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4]   2> 14423 T1812 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14733 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 14734 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51341_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51341"}
[junit4:junit4]   2> 14741 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14741 T1899 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14741 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14741 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14741 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 14741 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2>  C103_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51337_, base_url=http://127.0.0.1:51337}
[junit4:junit4]   2> 15102 T1886 C103 P51337 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51331/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 15102 T1886 C103 P51337 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51337 START replicas=[http://127.0.0.1:51331/collection1/] nUpdates=100
[junit4:junit4]   2> 15103 T1886 C103 P51337 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 15104 T1886 C103 P51337 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 15104 T1886 C103 P51337 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 15104 T1886 C103 P51337 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 15105 T1886 C103 P51337 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 15105 T1886 C103 P51337 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51331/collection1/. core=collection1
[junit4:junit4]   2> 15106 T1886 C103 P51337 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C105 name=collection1 org.apache.solr.core.SolrCore@6b57a274 url=http://127.0.0.1:51331/collection1 node=127.0.0.1:51331_ C105_STATE=coll:collection1 core:collection1 props:{shard=shard1, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51331_, base_url=http://127.0.0.1:51331, leader=true}
[junit4:junit4]   2> 15113 T1844 C105 P51331 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=1 
[junit4:junit4]   2> 15116 T1847 C105 P51331 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 15118 T1847 C105 P51331 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1
[junit4:junit4]   2> 15121 T1847 C105 P51331 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@284c3768; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 15122 T1847 C105 P51331 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 15125 T1847 C105 P51331 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@284c3768; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@284c3768; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15126 T1847 C105 P51331 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15127 T1847 C105 P51331 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1
[junit4:junit4]   2> 15127 T1847 C105 P51331 oass.SolrIndexSearcher.<init> Opening Searcher@7df611d2 realtime
[junit4:junit4]   2> 15127 T1847 C105 P51331 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15127 T1847 C105 P51331 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 11
[junit4:junit4]   2> 15129 T1886 C103 P51337 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15129 T1886 C103 P51337 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 15132 T1845 C105 P51331 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 15133 T1845 C105 P51331 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 15133 T1886 C103 P51337 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 15134 T1886 C103 P51337 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 15134 T1886 C103 P51337 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 15136 T1846 C105 P51331 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1
[junit4:junit4]   2> 15137 T1846 C105 P51331 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty1/index
[junit4:junit4]   2> 15137 T1846 C105 P51331 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 15138 T1886 C103 P51337 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 15139 T1886 C103 P51337 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index.20121227201522108 forceNew:false
[junit4:junit4]   2> 15140 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3
[junit4:junit4]   2> 15140 T1886 C103 P51337 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index.20121227201522108 lockFactory=org.apache.lucene.store.NativeFSLockFactory@638dbd6c; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 15145 T1848 C105 P51331 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=0 
[junit4:junit4]   2> 15147 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index
[junit4:junit4]   2> 15147 T1886 C103 P51337 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 15147 T1886 C103 P51337 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121227201522108
[junit4:junit4]   2> 15149 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3
[junit4:junit4]   2> 15149 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3
[junit4:junit4]   2> 15150 T1886 C103 P51337 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index.20121227201522108
[junit4:junit4]   2> 15152 T1886 C103 P51337 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index.20121227201522108 lockFactory=org.apache.lucene.store.NativeFSLockFactory@638dbd6c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15153 T1886 C103 P51337 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15155 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3
[junit4:junit4]   2> 15155 T1886 C103 P51337 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 15155 T1886 C103 P51337 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 15156 T1886 C103 P51337 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 15157 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index.20121227201522108
[junit4:junit4]   2> 15157 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3
[junit4:junit4]   2> 15160 T1886 C103 P51337 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index.20121227201522108 lockFactory=org.apache.lucene.store.NativeFSLockFactory@638dbd6c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 15160 T1886 C103 P51337 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 15161 T1886 C103 P51337 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 15161 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3
[junit4:junit4]   2> 15162 T1886 C103 P51337 oass.SolrIndexSearcher.<init> Opening Searcher@7185c76 main
[junit4:junit4]   2> 15164 T1885 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7185c76 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 15164 T1885 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index
[junit4:junit4]   2> 15165 T1886 C103 P51337 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 15167 T1886 C103 P51337 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index.20121227201522108 lockFactory=org.apache.lucene.store.NativeFSLockFactory@638dbd6c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index.20121227201522108 lockFactory=org.apache.lucene.store.NativeFSLockFactory@638dbd6c; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 15167 T1886 C103 P51337 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 15168 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3
[junit4:junit4]   2> 15168 T1886 C103 P51337 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 15169 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index.20121227201522108
[junit4:junit4]   2> 15169 T1886 C103 P51337 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty3/index
[junit4:junit4]   2> 15169 T1886 C103 P51337 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 15169 T1886 C103 P51337 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 15169 T1886 C103 P51337 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 15170 T1886 C103 P51337 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 15171 T1886 C103 P51337 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 15261 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 15264 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51337_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51337"}
[junit4:junit4]   2> 15279 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15279 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15280 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15279 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15281 T1899 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15280 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 15428 T1812 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16434 T1812 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2>  C104_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51341_, base_url=http://127.0.0.1:51341}
[junit4:junit4]   2> 17426 T1902 C104 P51341 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51334/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   2> 17427 T1902 C104 P51341 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51341 START replicas=[http://127.0.0.1:51334/collection1/] nUpdates=100
[junit4:junit4]   2> 17428 T1902 C104 P51341 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4]   2> 17429 T1902 C104 P51341 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   2> 17429 T1902 C104 P51341 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4]   2> 17430 T1902 C104 P51341 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4]   2> 17430 T1902 C104 P51341 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   2> 17431 T1902 C104 P51341 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51334/collection1/. core=collection1
[junit4:junit4]   2> 17433 T1902 C104 P51341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   2> ASYNC  NEW_CORE C106 name=collection1 org.apache.solr.core.SolrCore@a85744f url=http://127.0.0.1:51334/collection1 node=127.0.0.1:51334_ C106_STATE=coll:collection1 core:collection1 props:{shard=shard2, roles=null, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51334_, base_url=http://127.0.0.1:51334, leader=true}
[junit4:junit4]   2> 17443 T1864 C106 P51334 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=2 
[junit4:junit4]   2> 17444 T1812 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17446 T1862 C106 P51334 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 17447 T1862 C106 P51334 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2
[junit4:junit4]   2> 17450 T1862 C106 P51334 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d4fab1b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17451 T1862 C106 P51334 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17453 T1862 C106 P51334 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d4fab1b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d4fab1b; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 17454 T1862 C106 P51334 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 17454 T1862 C106 P51334 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2
[junit4:junit4]   2> 17455 T1862 C106 P51334 oass.SolrIndexSearcher.<init> Opening Searcher@12ac7bd3 realtime
[junit4:junit4]   2> 17455 T1862 C106 P51334 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 17455 T1862 C106 P51334 /update {waitSearcher=true&openSearcher=false&commit=true&commit_end_point=true&wt=javabin&softCommit=false&version=2} {commit=} 0 9
[junit4:junit4]   2> 17456 T1902 C104 P51341 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 17456 T1902 C104 P51341 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   2> 17459 T1859 C106 P51334 oash.ReplicationHandler.inform Commits will be reserved for  10000
[junit4:junit4]   2> 17459 T1859 C106 P51334 REQ /replication {command=indexversion&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
[junit4:junit4]   2> 17460 T1902 C104 P51341 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4]   2> 17460 T1902 C104 P51341 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4]   2> 17460 T1902 C104 P51341 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4]   2> 17462 T1860 C106 P51334 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2
[junit4:junit4]   2> 17463 T1860 C106 P51334 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty2/index
[junit4:junit4]   2> 17464 T1860 C106 P51334 REQ /replication {command=filelist&generation=2&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
[junit4:junit4]   2> 17464 T1902 C104 P51341 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4]   2> 17465 T1902 C104 P51341 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index.20121227201524435 forceNew:false
[junit4:junit4]   2> 17466 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4
[junit4:junit4]   2> 17467 T1902 C104 P51341 oash.SnapPuller.fetchLatestIndex Starting download to RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index.20121227201524435 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e3a2097; maxCacheMB=48.0 maxMergeSizeMB=4.0)) fullCopy=true
[junit4:junit4]   2> 17470 T1864 C106 P51334 REQ /replication {file=segments_2&command=filecontent&checksum=true&generation=2&qt=/replication&wt=filestream} status=0 QTime=1 
[junit4:junit4]   2> 17471 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index
[junit4:junit4]   2> 17477 T1902 C104 P51341 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4]   2> 17482 T1902 C104 P51341 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20121227201524435
[junit4:junit4]   2> 17483 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4
[junit4:junit4]   2> 17484 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4
[junit4:junit4]   2> 17484 T1902 C104 P51341 oasc.SolrCore.getNewIndexDir New index directory detected: old=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index/ new=./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index.20121227201524435
[junit4:junit4]   2> 17487 T1902 C104 P51341 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index.20121227201524435 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e3a2097; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 17488 T1902 C104 P51341 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 17489 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4
[junit4:junit4]   2> 17489 T1902 C104 P51341 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4]   2> 17490 T1902 C104 P51341 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   2> 17490 T1902 C104 P51341 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
[junit4:junit4]   2> 17490 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index.20121227201524435
[junit4:junit4]   2> 17491 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4
[junit4:junit4]   2> 17493 T1902 C104 P51341 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index.20121227201524435 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e3a2097; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 17493 T1902 C104 P51341 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4]   2> 17494 T1902 C104 P51341 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4]   2> 17494 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4
[junit4:junit4]   2> 17495 T1902 C104 P51341 oass.SolrIndexSearcher.<init> Opening Searcher@274be5a4 main
[junit4:junit4]   2> 17497 T1901 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@274be5a4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   2> 17498 T1901 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index
[junit4:junit4]   2> 17498 T1902 C104 P51341 oasu.DirectUpdateHandler2.commit start commit{flags=0,_version_=0,optimize=false,openSearcher=false,waitSearcher=false,expungeDeletes=false,softCommit=false}
[junit4:junit4]   2> 17501 T1902 C104 P51341 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index.20121227201524435 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e3a2097; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index.20121227201524435 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e3a2097; maxCacheMB=48.0 maxMergeSizeMB=4.0)),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4]   2> 17501 T1902 C104 P51341 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4]   2> 17502 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4
[junit4:junit4]   2> 17503 T1902 C104 P51341 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4]   2> 17503 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index.20121227201524435
[junit4:junit4]   2> 17503 T1902 C104 P51341 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-1356657306979/jetty4/index
[junit4:junit4]   2> 17504 T1902 C104 P51341 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4]   2> 17504 T1902 C104 P51341 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   2> 17504 T1902 C104 P51341 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 17505 T1902 C104 P51341 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17507 T1902 C104 P51341 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4]   2> 17816 T1835 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17817 T1835 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":"2",
[junit4:junit4]   2> 	  "shard":"shard2",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:51341_",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:51341"}
[junit4:junit4]   2> 17823 T1853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17823 T1834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17824 T1883 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17824 T1868 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17824 T1840 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   2> 17824 T1899 oascc.ZkStateReader$2.process 

[...truncated too long message...]

elegatingMethodAccessorImpl.java:43)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 375232 T1812 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene41: {n_f1=PostingsFormat(name=MockSep), foo_b=MockFixedIntBlock(blockSize=1901), cat=PostingsFormat(name=MockRandom), foo_d=PostingsFormat(name=Memory doPackFST= false), foo_f=MockFixedIntBlock(blockSize=1901), n_tl1=PostingsFormat(name=MockSep), n_d1=PostingsFormat(name=MockRandom), rnd_b=PostingsFormat(name=Memory doPackFST= false), intDefault=PostingsFormat(name=MockRandom), n_td1=PostingsFormat(name=MockSep), timestamp=PostingsFormat(name=MockRandom), id=PostingsFormat(name=Memory doPackFST= false), range_facet_sl=MockFixedIntBlock(blockSize=1901), range_facet_si=PostingsFormat(name=MockSep), oddField_s=MockFixedIntBlock(blockSize=1901), sequence_i=MockFixedIntBlock(blockSize=1901), name=PostingsFormat(name=Memory doPackFST= false), foo_i=PostingsFormat(name=MockSep), regex_dup_B_s=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=MockSep), n_tf1=PostingsFormat(name=MockRandom), n_dt1=PostingsFormat(name=MockSep), genre_s=MockFixedIntBlock(blockSize=1901), author_t=PostingsFormat(name=MockSep), n_ti1=PostingsFormat(name=Memory doPackFST= false), range_facet_l=PostingsFormat(name=MockRandom), text=MockFixedIntBlock(blockSize=1901), _version_=PostingsFormat(name=MockRandom), val_i=PostingsFormat(name=Memory doPackFST= false), SubjectTerms_mfacet=PostingsFormat(name=MockRandom), series_t=PostingsFormat(name=MockSep), a_t=PostingsFormat(name=MockRandom), n_tdt1=PostingsFormat(name=MockRandom), regex_dup_A_s=MockFixedIntBlock(blockSize=1901), price=MockFixedIntBlock(blockSize=1901), other_tl1=PostingsFormat(name=MockRandom), n_l1=PostingsFormat(name=MockRandom), a_si=PostingsFormat(name=MockSep), inStock=MockFixedIntBlock(blockSize=1901)}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=cs, timezone=Pacific/Easter
[junit4:junit4]   2> NOTE: Mac OS X 10.8.2 x86_64/Oracle Corporation 1.7.0_10 (64-bit)/cpus=2,threads=1,free=346152880,total=519438336
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestZkChroot, SimplePostToolTest, ExternalFileFieldSortTest, LeaderElectionIntegrationTest, TestIndexingPerformance, ResourceLoaderTest, ShowFileRequestHandlerTest, DirectSolrSpellCheckerTest, TestJmxMonitoredMap, TestHashPartitioner, TestUtils, QueryElevationComponentTest, TestPHPSerializedResponseWriter, DebugComponentTest, SystemInfoHandlerTest, BasicFunctionalityTest, TestStressLucene, TermVectorComponentTest, TestWriterPerf, QueryParsingTest, TestXIncludeConfig, TestMergePolicyConfig, DateFieldTest, ConvertedLegacyTest, SolrIndexConfigTest, SuggesterTest, TestSort, ShardRoutingTest, CacheHeaderTest, NoCacheHeaderTest, TestArbitraryIndexDir, ScriptEngineTest, TestLFUCache, UUIDFieldTest, CircularListTest, TestBM25SimilarityFactory, PathHierarchyTokenizerFactoryTest, TestLMJelinekMercerSimilarityFactory, OutputWriterTest, SignatureUpdateProcessorFactoryTest, PreAnalyzedFieldTest, TestRemoteStreaming, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, BadIndexSchemaTest, TestIBSimilarityFactory, TestBinaryField, SpellCheckComponentTest, OverseerTest, CurrencyFieldTest, TestCodecSupport, AutoCommitTest, ChaosMonkeySafeLeaderTest, DocumentBuilderTest, StatsComponentTest, TestSystemIdResolver, DistributedQueryElevationComponentTest, TestCSVLoader, TestReversedWildcardFilterFactory, TestFuzzyAnalyzedSuggestions, PluginInfoTest, TestPerFieldSimilarity, SimpleFacetsTest, TestStressReorder, TestRecovery, ReturnFieldsTest, SolrRequestParserTest, ClusterStateTest, SchemaVersionSpecificBehaviorTest, FastVectorHighlighterTest, TestDistributedSearch, DOMUtilTest, TestCollationField, RecoveryZkTest, TestOmitPositions, TestJmxIntegration, TestJoin, SolrInfoMBeanTest, BasicZkTest, TestLazyCores, TestRTGBase, LukeRequestHandlerTest, NumericFieldsTest, TestPseudoReturnFields, HighlighterTest, StatelessScriptUpdateProcessorFactoryTest, TestMultiCoreConfBootstrap, TestSolrCoreProperties, IndexReaderFactoryTest, OverseerCollectionProcessorTest, WordBreakSolrSpellCheckerTest, HighlighterConfigTest, FieldAnalysisRequestHandlerTest, PeerSyncTest, SpellingQueryConverterTest, TestCoreContainer, SolrCoreTest, BasicDistributedZkTest]
[junit4:junit4] Completed in 375.67s, 1 test, 1 failure <<< FAILURES!

[...truncated 442 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:353: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:178: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:438: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1176: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:841: There were test failures: 243 suites, 1009 tests, 1 failure, 13 ignored (2 assumptions)

Total time: 184 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build # 6 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/6/
Java: 64bit/jdk1.6.0 -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([3DDDBCDA3FA3E83C:8356DA7546D9E609]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterStateUpdateTest.java:234)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:680)




Build Log:
[...truncated 8138 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ClusterStateUpdateTest
[junit4:junit4]   2> 6 T1578 oas.SolrTestCaseJ4.setUp ###Starting testCoreRegistration
[junit4:junit4]   2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068
[junit4:junit4]   2> 7 T1578 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 8 T1579 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4]   2> 10 T1579 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 10 T1579 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4]   2> 11 T1579 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4]   2> 11 T1579 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 11 T1578 oasc.ZkTestServer.run start zk server on port:49927
[junit4:junit4]   2> 12 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2d022136
[junit4:junit4]   2> 13 T1579 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4]   2> 15 T1581 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 16 T1581 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 16 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49928
[junit4:junit4]   2> 17 T1580 oazs.NIOServerCnxn.doIO WARNING Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4:junit4]   2> 17 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 23 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49928 (no session established for client)
[junit4:junit4]   2> 24 T1581 oaz.ClientCnxn$SendThread.run Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
[junit4:junit4]   2> 1868 T1581 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 1870 T1581 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 1870 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49929
[junit4:junit4]   2> 1871 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49929
[junit4:junit4]   2> 1871 T1584 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 1874 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d50000 with negotiated timeout 10000 for client /127.0.0.1:49929
[junit4:junit4]   2> 1874 T1581 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d50000, negotiated timeout = 10000
[junit4:junit4]   2> 1876 T1582 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d022136 name:ZooKeeperConnection Watcher:127.0.0.1:49927 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1876 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1877 T1578 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 1882 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d50000
[junit4:junit4]   2> 1890 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49929 which had sessionid 0x13bde6583d50000
[junit4:junit4]   2> 1890 T1578 oaz.ZooKeeper.close Session: 0x13bde6583d50000 closed
[junit4:junit4]   2> 1890 T1582 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1891 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@46566b27
[junit4:junit4]   2> 1891 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1892 T1586 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 1893 T1586 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 1893 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49930
[junit4:junit4]   2> 1894 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49930
[junit4:junit4]   2> 1895 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d50001 with negotiated timeout 10000 for client /127.0.0.1:49930
[junit4:junit4]   2> 1895 T1586 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d50001, negotiated timeout = 10000
[junit4:junit4]   2> 1896 T1587 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46566b27 name:ZooKeeperConnection Watcher:127.0.0.1:49927/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1896 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1897 T1578 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4]   2> 1903 T1578 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4]   2> 1908 T1578 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4]   2> 1913 T1578 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4]   2> 1918 T1578 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 1919 T1578 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   2> 1927 T1578 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   2> 1928 T1578 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4]   2> 1935 T1578 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   2> 1936 T1578 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   2> 1943 T1578 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   2> 1944 T1578 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4]   2> 1949 T1578 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   2> 1950 T1578 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4]   2> 1958 T1578 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 1959 T1578 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   2> 1965 T1578 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 1966 T1578 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   2> 1974 T1578 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 1975 T1578 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   2> 1982 T1578 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   2> 1982 T1578 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   2> 1988 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d50001
[junit4:junit4]   2> 1989 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49930 which had sessionid 0x13bde6583d50001
[junit4:junit4]   2> 1989 T1587 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1989 T1578 oaz.ZooKeeper.close Session: 0x13bde6583d50001 closed
[junit4:junit4]   2> 1990 T1578 oasc.ClusterStateUpdateTest.setUp ####SETUP_START testCoreRegistration
[junit4:junit4]   2> 1993 T1578 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 1993 T1578 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 1994 T1578 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 1994 T1578 oasc.CoreContainer.<init> New CoreContainer 1998953417
[junit4:junit4]   2> 1994 T1578 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 1995 T1578 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 2030 T1578 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 2031 T1578 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 2032 T1578 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 2032 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 2033 T1578 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 2033 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 2034 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 2034 T1578 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 2034 T1578 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 2035 T1578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 2064 T1578 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 2084 T1578 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49927/solr
[junit4:junit4]   2> 2085 T1578 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 2085 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@9654f70
[junit4:junit4]   2> 2086 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2087 T1588 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2089 T1588 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 2089 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49931
[junit4:junit4]   2> 2090 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49931
[junit4:junit4]   2> 2091 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d50002 with negotiated timeout 20000 for client /127.0.0.1:49931
[junit4:junit4]   2> 2091 T1588 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d50002, negotiated timeout = 20000
[junit4:junit4]   2> 2092 T1589 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9654f70 name:ZooKeeperConnection Watcher:127.0.0.1:49927 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2095 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2101 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d50002
[junit4:junit4]   2> 2102 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49931 which had sessionid 0x13bde6583d50002
[junit4:junit4]   2> 2102 T1578 oaz.ZooKeeper.close Session: 0x13bde6583d50002 closed
[junit4:junit4]   2> 2103 T1578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 2110 T1589 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 2116 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ccb457c
[junit4:junit4]   2> 2117 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 2119 T1590 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 2120 T1590 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 2121 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49932
[junit4:junit4]   2> 2121 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49932
[junit4:junit4]   2> 2122 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d50003 with negotiated timeout 3000 for client /127.0.0.1:49932
[junit4:junit4]   2> 2122 T1590 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d50003, negotiated timeout = 3000
[junit4:junit4]   2> 2123 T1591 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ccb457c name:ZooKeeperConnection Watcher:127.0.0.1:49927/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 2123 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 2125 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2127 T1578 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 2135 T1578 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 2135 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:delete cxid:0x7 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1661_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 2136 T1578 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1661_solr
[junit4:junit4]   2> 2141 T1578 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 2150 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:delete cxid:0x15 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 2152 T1578 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 2156 T1578 oasc.Overseer.start Overseer (id=88909145248694275-127.0.0.1:1661_solr-n_0000000000) starting
[junit4:junit4]   2> 2157 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x1a zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2158 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x1b zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2160 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x1c zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2162 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x1d zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2163 T1593 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 2164 T1578 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 2168 T1578 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 2172 T1592 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 2178 T1594 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 2178 T1594 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 2179 T1594 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 2180 T1594 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 2182 T1594 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 2183 T1594 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 2184 T1594 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 2251 T1594 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 2324 T1594 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 2326 T1594 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 2331 T1594 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 2982 T1594 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 2991 T1594 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 2996 T1594 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 3021 T1594 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3025 T1594 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 3031 T1594 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3034 T1594 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 3036 T1594 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1/
[junit4:junit4]   2> 3036 T1594 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51f21c50
[junit4:junit4]   2> 3037 T1594 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 3038 T1594 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1 forceNew:false
[junit4:junit4]   2> 3038 T1594 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1
[junit4:junit4]   2> 3038 T1594 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1/index/
[junit4:junit4]   2> 3038 T1594 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 3039 T1594 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1/index forceNew:false
[junit4:junit4]   2> 3041 T1594 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@432fec lockFactory=org.apache.lucene.store.NativeFSLockFactory@476c6b9c)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 3041 T1594 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 3042 T1594 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1/index
[junit4:junit4]   2> 3042 T1594 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 3044 T1594 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 3044 T1594 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 3044 T1594 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 3045 T1594 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 3045 T1594 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 3046 T1594 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 3046 T1594 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 3047 T1594 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 3047 T1594 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 3047 T1594 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 3048 T1594 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 3048 T1594 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 3049 T1594 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 3049 T1594 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 3049 T1594 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 3050 T1594 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 3050 T1594 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3050 T1594 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3051 T1594 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3051 T1594 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3052 T1594 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3052 T1594 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3053 T1594 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3054 T1594 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 3054 T1594 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 3055 T1594 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 3062 T1594 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 3065 T1594 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 3066 T1594 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 3069 T1594 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1
[junit4:junit4]   2> 3069 T1594 oass.SolrIndexSearcher.<init> Opening Searcher@150a7a57 main
[junit4:junit4]   2> 3070 T1594 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 3070 T1594 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 3070 T1594 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 3077 T1594 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 3107 T1595 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@150a7a57 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 3112 T1594 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 3112 T1594 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 3113 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x53 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 3182 T1592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3184 T1592 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 3184 T1592 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 3185 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x5b zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 3194 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4118 T1594 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 4118 T1594 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1661/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 4119 T1594 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4133 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:delete cxid:0x78 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 4134 T1594 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 4134 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x79 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4137 T1594 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 4138 T1594 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 4138 T1594 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 4138 T1594 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 4148 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x83 zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4205 T1592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4218 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4253 T1594 oasc.ZkController.register We are http://127.0.0.1:1661/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 4254 T1594 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 4254 T1594 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 4254 T1594 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 4257 T1594 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4258 T1578 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 4259 T1578 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 4259 T1578 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 4259 T1578 oasc.CoreContainer.<init> New CoreContainer 999955799
[junit4:junit4]   2> 4260 T1578 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 4260 T1578 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 4294 T1578 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 4294 T1578 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 4294 T1578 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 4295 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 4295 T1578 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 4295 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 4295 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 4296 T1578 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 4296 T1578 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 4296 T1578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 4318 T1578 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 4339 T1578 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49927/solr
[junit4:junit4]   2> 4339 T1578 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 4340 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@57936f92
[junit4:junit4]   2> 4341 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4341 T1596 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4343 T1596 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 4343 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49933
[junit4:junit4]   2> 4343 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49933
[junit4:junit4]   2> 4345 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d50004 with negotiated timeout 20000 for client /127.0.0.1:49933
[junit4:junit4]   2> 4345 T1596 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d50004, negotiated timeout = 20000
[junit4:junit4]   2> 4346 T1597 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57936f92 name:ZooKeeperConnection Watcher:127.0.0.1:49927 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4346 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4349 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d50004
[junit4:junit4]   2> 4350 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49933 which had sessionid 0x13bde6583d50004
[junit4:junit4]   2> 4350 T1597 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 4350 T1578 oaz.ZooKeeper.close Session: 0x13bde6583d50004 closed
[junit4:junit4]   2> 4351 T1578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 4360 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@2c257268
[junit4:junit4]   2> 4361 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4362 T1598 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 4363 T1598 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 4363 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49934
[junit4:junit4]   2> 4364 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49934
[junit4:junit4]   2> 4366 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d50005 with negotiated timeout 3000 for client /127.0.0.1:49934
[junit4:junit4]   2> 4366 T1598 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d50005, negotiated timeout = 3000
[junit4:junit4]   2> 4367 T1599 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c257268 name:ZooKeeperConnection Watcher:127.0.0.1:49927/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4367 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4369 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50005 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4370 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50005 type:create cxid:0x2 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4372 T1578 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 4373 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50005 type:delete cxid:0x4 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1662_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 4374 T1578 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1662_solr
[junit4:junit4]   2> 4377 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 4379 T1591 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 4382 T1578 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 4390 T1600 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 4390 T1600 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 4391 T1600 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 4391 T1600 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 4393 T1600 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 4394 T1600 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 4395 T1600 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 4464 T1600 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 4544 T1600 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 4545 T1600 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 4551 T1600 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 4728 T1592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4729 T1592 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 4735 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 4736 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5157 T1600 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 5168 T1600 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 5172 T1600 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 5197 T1600 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5201 T1600 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 5205 T1600 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5207 T1600 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 5209 T1600 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2/
[junit4:junit4]   2> 5210 T1600 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51f21c50
[junit4:junit4]   2> 5210 T1600 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 5211 T1600 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2 forceNew:false
[junit4:junit4]   2> 5211 T1600 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2
[junit4:junit4]   2> 5212 T1600 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2/index/
[junit4:junit4]   2> 5212 T1600 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 5213 T1600 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2/index forceNew:false
[junit4:junit4]   2> 5215 T1600 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@1e088447 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b49f171)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 5216 T1600 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 5216 T1600 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2/index
[junit4:junit4]   2> 5217 T1600 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 5219 T1600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 5219 T1600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 5219 T1600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 5220 T1600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 5220 T1600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 5221 T1600 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 5221 T1600 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 5222 T1600 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 5222 T1600 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 5223 T1600 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 5224 T1600 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 5225 T1600 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 5225 T1600 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 5226 T1600 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 5226 T1600 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 5227 T1600 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 5227 T1600 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5228 T1600 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5229 T1600 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5229 T1600 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5230 T1600 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5230 T1600 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5231 T1600 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5231 T1600 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 5232 T1600 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 5232 T1600 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 5236 T1600 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 5240 T1600 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 5242 T1600 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 5245 T1600 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2
[junit4:junit4]   2> 5245 T1600 oass.SolrIndexSearcher.<init> Opening Searcher@7f6a889d main
[junit4:junit4]   2> 5246 T1600 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 5246 T1600 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 5247 T1600 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 5252 T1600 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 5281 T1601 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f6a889d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 5287 T1600 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 5287 T1600 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 5748 T1592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 5751 T1592 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1662_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1662/solr"}
[junit4:junit4]   2> 5751 T1592 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 5751 T1592 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 5763 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 5763 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6290 T1600 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 6290 T1600 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1662/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 6297 T1600 oasc.ZkController.register We are http://127.0.0.1:1662/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 6297 T1600 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 6297 T1600 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 6298 T1600 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 6301 T1600 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6302 T1578 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 6303 T1578 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr
[junit4:junit4]   2> 6303 T1578 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/solr.xml
[junit4:junit4]   2> 6303 T1578 oasc.CoreContainer.<init> New CoreContainer 184616510
[junit4:junit4]   2> 6304 T1578 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 6304 T1578 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/'
[junit4:junit4]   2> 6331 T1578 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 30000
[junit4:junit4]   2> 6331 T1578 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 6332 T1578 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4]   2> 6333 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 6333 T1578 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 6333 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 6334 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 6334 T1578 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 6334 T1578 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 6335 T1578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=30000&connTimeout=15000&retry=false
[junit4:junit4]   2> 6350 T1578 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 6365 T1578 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49927/solr
[junit4:junit4]   2> 6365 T1578 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 6365 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@30a777ed
[junit4:junit4]   2> 6366 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6367 T1602 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6368 T1602 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 6368 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49935
[junit4:junit4]   2> 6369 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49935
[junit4:junit4]   2> 6370 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d50006 with negotiated timeout 20000 for client /127.0.0.1:49935
[junit4:junit4]   2> 6370 T1602 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d50006, negotiated timeout = 20000
[junit4:junit4]   2> 6371 T1603 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30a777ed name:ZooKeeperConnection Watcher:127.0.0.1:49927 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6372 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6374 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d50006
[junit4:junit4]   2> 6375 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49935 which had sessionid 0x13bde6583d50006
[junit4:junit4]   2> 6375 T1603 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6375 T1578 oaz.ZooKeeper.close Session: 0x13bde6583d50006 closed
[junit4:junit4]   2> 6376 T1578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=15000&connTimeout=30000
[junit4:junit4]   2> 6381 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@fdcda7f
[junit4:junit4]   2> 6382 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6382 T1604 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 6383 T1604 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 6384 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49936
[junit4:junit4]   2> 6384 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49936
[junit4:junit4]   2> 6385 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d50007 with negotiated timeout 3000 for client /127.0.0.1:49936
[junit4:junit4]   2> 6385 T1604 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d50007, negotiated timeout = 3000
[junit4:junit4]   2> 6386 T1605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fdcda7f name:ZooKeeperConnection Watcher:127.0.0.1:49927/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6386 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6387 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50007 type:create cxid:0x1 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6389 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50007 type:create cxid:0x2 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6390 T1578 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 6391 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50007 type:delete cxid:0x4 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:1663_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 6392 T1578 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:1663_solr
[junit4:junit4]   2> 6395 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6395 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   2> 6398 T1591 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 6398 T1599 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 6409 T1578 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6417 T1606 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1
[junit4:junit4]   2> 6417 T1606 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 6419 T1606 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 6419 T1606 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 6421 T1606 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4]   2> 6421 T1606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4]   2> 6422 T1606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4]   2> 6468 T1606 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 6542 T1606 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 6544 T1606 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 6549 T1606 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 6780 T1592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6781 T1592 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1662_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1662/solr"}
[junit4:junit4]   2> 6788 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6791 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 6791 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7245 T1606 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 7258 T1606 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 7264 T1606 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 7297 T1606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7302 T1606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 7311 T1606 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7313 T1606 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 7316 T1606 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/
[junit4:junit4]   2> 7316 T1606 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51f21c50
[junit4:junit4]   2> 7317 T1606 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 7318 T1606 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3 forceNew:false
[junit4:junit4]   2> 7319 T1606 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3
[junit4:junit4]   2> 7319 T1606 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index/
[junit4:junit4]   2> 7320 T1606 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 7321 T1606 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index forceNew:false
[junit4:junit4]   2> 7324 T1606 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@2dbf6c74 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5ec3dfdc)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 7325 T1606 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 7325 T1606 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index
[junit4:junit4]   2> 7326 T1606 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 7330 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 7330 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 7330 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 7331 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 7331 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 7332 T1606 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 7332 T1606 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 7333 T1606 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 7334 T1606 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 7334 T1606 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 7335 T1606 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 7336 T1606 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 7337 T1606 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 7337 T1606 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 7338 T1606 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 7338 T1606 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 7339 T1606 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7340 T1606 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7341 T1606 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7342 T1606 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7343 T1606 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7344 T1606 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7344 T1606 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7345 T1606 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 7346 T1606 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 7346 T1606 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 7351 T1606 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 7355 T1606 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 7358 T1606 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 7368 T1606 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3
[junit4:junit4]   2> 7369 T1606 oass.SolrIndexSearcher.<init> Opening Searcher@7a12ff5c main
[junit4:junit4]   2> 7369 T1606 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 7369 T1606 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 7369 T1606 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 7373 T1606 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 7413 T1607 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7a12ff5c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 7421 T1606 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 7422 T1606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 7809 T1592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7810 T1592 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
[junit4:junit4]   2> 7810 T1592 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 7810 T1592 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 7821 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7822 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 7823 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8426 T1606 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 8426 T1606 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:1663/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 8432 T1606 oasc.ZkController.register We are http://127.0.0.1:1663/solr/collection1/ and leader is http://127.0.0.1:1661/solr/collection1/
[junit4:junit4]   2> 8432 T1606 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 8432 T1606 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 8432 T1606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 8434 T1606 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8436 T1578 oasc.ClusterStateUpdateTest.setUp ####SETUP_END testCoreRegistration
[junit4:junit4]   2> 8436 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@115e194f
[junit4:junit4]   2> 8437 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8438 T1608 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 8439 T1608 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 8439 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49937
[junit4:junit4]   2> 8439 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49937
[junit4:junit4]   2> 8441 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d50008 with negotiated timeout 10000 for client /127.0.0.1:49937
[junit4:junit4]   2> 8441 T1608 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d50008, negotiated timeout = 10000
[junit4:junit4]   2> 8441 T1609 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@115e194f name:ZooKeeperConnection Watcher:127.0.0.1:49927/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8442 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8442 T1578 oascc.SolrZkClient.makePath makePath: /collections/testcore
[junit4:junit4]   2> 8446 T1578 oascc.SolrZkClient.makePath makePath: /collections/testcore/shards
[junit4:junit4]   2> 8451 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d50008
[junit4:junit4]   2> 8452 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49937 which had sessionid 0x13bde6583d50008
[junit4:junit4]   2> 8452 T1578 oaz.ZooKeeper.close Session: 0x13bde6583d50008 closed
[junit4:junit4]   2> 8452 T1609 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8453 T1578 oasc.CoreContainer.create Creating SolrCore 'testcore' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore
[junit4:junit4]   2> 8453 T1578 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testcore
[junit4:junit4]   2> 8454 T1578 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 8454 T1578 oasc.ZkController.readConfigName Load collection config from:/collections/testcore
[junit4:junit4]   2> 8456 T1578 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore/'
[junit4:junit4]   2> 8518 T1578 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 8602 T1578 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 8604 T1578 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 8609 T1578 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 8838 T1592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8838 T1592 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1663_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1663/solr"}
[junit4:junit4]   2> 8843 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8845 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 8845 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9267 T1578 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 9277 T1578 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 9283 T1578 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 9328 T1578 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9334 T1578 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 9339 T1578 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9341 T1578 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 9343 T1578 oasc.SolrCore.<init> [testcore] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/testcore/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4/
[junit4:junit4]   2> 9344 T1578 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51f21c50
[junit4:junit4]   2> 9345 T1578 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 9347 T1578 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4 forceNew:false
[junit4:junit4]   2> 9348 T1578 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4
[junit4:junit4]   2> 9349 T1578 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4/index/
[junit4:junit4]   2> 9350 T1578 oasc.SolrCore.initIndex WARNING [testcore] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 9352 T1578 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4/index forceNew:false
[junit4:junit4]   2> 9355 T1578 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a0568d8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17253394)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 9355 T1578 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 9357 T1578 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4/index
[junit4:junit4]   2> 9357 T1578 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 9360 T1578 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 9361 T1578 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 9361 T1578 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 9362 T1578 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 9362 T1578 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 9363 T1578 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 9363 T1578 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 9364 T1578 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 9365 T1578 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 9365 T1578 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 9366 T1578 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 9366 T1578 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 9367 T1578 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 9367 T1578 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 9368 T1578 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 9368 T1578 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 9369 T1578 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9369 T1578 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9370 T1578 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9370 T1578 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9371 T1578 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9371 T1578 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9372 T1578 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9373 T1578 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 9373 T1578 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 9374 T1578 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 9379 T1578 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 9382 T1578 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 9384 T1578 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 9386 T1578 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4
[junit4:junit4]   2> 9387 T1578 oass.SolrIndexSearcher.<init> Opening Searcher@25e0df1b main
[junit4:junit4]   2> 9387 T1578 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 9388 T1578 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 9388 T1578 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 9394 T1578 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 9428 T1610 oasc.SolrCore.registerSearcher [testcore] Registered new searcher Searcher@25e0df1b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 9433 T1578 oasc.ZkController.publish publishing core=testcore state=down
[junit4:junit4]   2> 9433 T1578 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 9855 T1592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9856 T1592 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 9856 T1592 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 9862 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9862 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 9862 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10438 T1578 oasc.CoreContainer.registerCore registering core: testcore
[junit4:junit4]   2> 10439 T1578 oasc.ZkController.register Register replica - core:testcore address:http://127.0.0.1:1661/solr collection:testcore shard:shard1
[junit4:junit4]   2> 10441 T1578 oascc.SolrZkClient.makePath makePath: /collections/testcore/leader_elect/shard1/election
[junit4:junit4]   2> 10464 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:delete cxid:0x150 zxid:0x7c txntype:-1 reqpath:n/a Error Path:/solr/collections/testcore/leaders Error:KeeperErrorCode = NoNode for /solr/collections/testcore/leaders
[junit4:junit4]   2> 10466 T1578 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 10468 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x151 zxid:0x7d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10475 T1578 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4]   2> 10475 T1578 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 10476 T1578 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:1661/solr/testcore/
[junit4:junit4]   2> 10477 T1578 oascc.SolrZkClient.makePath makePath: /collections/testcore/leaders/shard1
[junit4:junit4]   2> 10491 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d50003 type:create cxid:0x15b zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 10878 T1592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10894 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10895 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10894 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10910 T1578 oasc.ZkController.register We are http://127.0.0.1:1661/solr/testcore/ and leader is http://127.0.0.1:1661/solr/testcore/
[junit4:junit4]   2> 10911 T1578 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 10911 T1578 oasc.ZkController.publish publishing core=testcore state=active
[junit4:junit4]   2> 10912 T1578 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 10915 T1578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 10917 T1578 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=184616510
[junit4:junit4]   2> 10918 T1578 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6f4d91c6
[junit4:junit4]   2> 10927 T1578 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 10927 T1578 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 10928 T1578 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 10928 T1578 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 10929 T1578 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 10929 T1578 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index
[junit4:junit4]   2> 10930 T1578 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3
[junit4:junit4]   2> 10930 T1578 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3
[junit4:junit4]   2> 10931 T1578 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index
[junit4:junit4]   2> 10931 T1578 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index
[junit4:junit4]   2> 10932 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d50007
[junit4:junit4]   2> 10933 T1599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10934 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 10934 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49936 which had sessionid 0x13bde6583d50007
[junit4:junit4]   2> 10934 T1578 oaz.ZooKeeper.close Session: 0x13bde6583d50007 closed
[junit4:junit4]   2> 10936 T1599 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 10936 T1591 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 11137 T1578 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=999955799
[junit4:junit4]   2> 11139 T1599 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11139 T1580 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13bde6583d50005, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 11138 T1578 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3d65613
[junit4:junit4]   2> 11141 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49934 which had sessionid 0x13bde6583d50005
[junit4:junit4]   2> 11146 T1578 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 11147 T1578 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 11148 T1578 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 11149 T1578 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 11150 T1578 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 11153 T1578 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2/index
[junit4:junit4]   2> 11154 T1578 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2
[junit4:junit4]   2> 11155 T1578 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2
[junit4:junit4]   2> 11156 T1578 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2/index
[junit4:junit4]   2> 11158 T1578 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data2/index
[junit4:junit4]   2> 11161 T1578 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   2> 11163 T1578 oasc.SolrResourceLoader.locateSolrHome solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4:junit4]   2> 11165 T1578 oasc.CoreContainer$Initializer.initialize looking for solr.xml: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/solr/solr.xml
[junit4:junit4]   2> 11166 T1578 oasc.CoreContainer.<init> New CoreContainer 1191005881
[junit4:junit4]   2> 11169 T1578 oasc.CoreContainer$Initializer.initialize no solr.xml file found - using default
[junit4:junit4]   2> 11170 T1578 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'solr/'
[junit4:junit4]   2> 11171 T1578 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'solr/'
[junit4:junit4]   2> 11205 T1578 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4]   2> 11205 T1578 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4]   2> 11206 T1578 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4]   2> 11206 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4]   2> 11206 T1578 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4]   2> 11207 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4]   2> 11207 T1578 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4]   2> 11207 T1578 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4]   2> 11208 T1578 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4]   2> 11208 T1578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   2> 11221 T1578 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4]   2> 11239 T1578 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49927/solr
[junit4:junit4]   2> 11240 T1578 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4]   2> 11241 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@20498030
[junit4:junit4]   2> 11244 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11245 T1611 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 11246 T1611 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 11247 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49938
[junit4:junit4]   2> 11247 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49938
[junit4:junit4]   2> 11248 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d50009 with negotiated timeout 20000 for client /127.0.0.1:49938
[junit4:junit4]   2> 11249 T1611 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d50009, negotiated timeout = 20000
[junit4:junit4]   2> 11249 T1612 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20498030 name:ZooKeeperConnection Watcher:127.0.0.1:49927 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11249 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11251 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d50009
[junit4:junit4]   2> 11252 T1578 oaz.ZooKeeper.close Session: 0x13bde6583d50009 closed
[junit4:junit4]   2> 11252 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49938 which had sessionid 0x13bde6583d50009
[junit4:junit4]   2> 11252 T1612 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11253 T1578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=0&connTimeout=0
[junit4:junit4]   2> 12235 T1605 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 16632 T1578 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@5f79d27c
[junit4:junit4]   2> 16632 T1590 oaz.ClientCnxn$SendThread.run Client session timed out, have not heard from server in 5005ms for sessionid 0x13bde6583d50003, closing socket connection and attempting reconnect
[junit4:junit4]   2> 13944 T1583 oazs.ZooKeeperServer.expire Expiring session 0x13bde6583d50005, timeout of 3000ms exceeded
[junit4:junit4]   2> 16632 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   2> 16633 T1578 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 16633 T1583 oazs.ZooKeeperServer.expire Expiring session 0x13bde6583d50003, timeout of 3000ms exceeded
[junit4:junit4]   2> 16634 T1613 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 16633 T1580 oazs.NIOServerCnxn.doIO WARNING caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13bde6583d50003, likely client has closed socket
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 
[junit4:junit4]   2> 16634 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d50005
[junit4:junit4]   2> 16633 T1605 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 16635 T1605 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 16635 T1613 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 16635 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d50003
[junit4:junit4]   2> 16645 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49932 which had sessionid 0x13bde6583d50003
[junit4:junit4]   2> 16646 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49939
[junit4:junit4]   2> 16646 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49939
[junit4:junit4]   2> 16647 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d5000a with negotiated timeout 3000 for client /127.0.0.1:49939
[junit4:junit4]   2> 16648 T1613 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d5000a, negotiated timeout = 3000
[junit4:junit4]   2> 16648 T1614 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f79d27c name:ZooKeeperConnection Watcher:127.0.0.1:49927/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 16648 T1578 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 16649 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:create cxid:0x1 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16651 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:create cxid:0x2 zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16653 T1578 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 16653 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:delete cxid:0x4 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/192.168.57.17:8983_solr Error:KeeperErrorCode = NoNode for /solr/live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 16654 T1578 oascc.SolrZkClient.makePath makePath: /live_nodes/192.168.57.17:8983_solr
[junit4:junit4]   2> 16661 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:delete cxid:0xd zxid:0x96 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 16661 T1578 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 16665 T1578 oasc.Overseer.start Overseer (id=88909145248694282-192.168.57.17:8983_solr-n_0000000003) starting
[junit4:junit4]   2> 16665 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:create cxid:0x12 zxid:0x98 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16667 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:create cxid:0x13 zxid:0x99 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16668 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:create cxid:0x14 zxid:0x9a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16669 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:create cxid:0x15 zxid:0x9b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 16670 T1616 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 16671 T1578 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 16674 T1615 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 16677 T1615 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 16678 T1615 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 16678 T1617 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: solr/collection1
[junit4:junit4]   2> 16679 T1617 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4]   2> 16680 T1617 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4]   2> 16680 T1617 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4]   2> 16682 T1617 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'solr/collection1/'
[junit4:junit4]   2> 16684 T1614 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 16733 T1591 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ccb457c name:ZooKeeperConnection Watcher:127.0.0.1:49927/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4]   2> 16734 T1591 oascc.ConnectionManager.process zkClient has disconnected
[junit4:junit4]   2> 16734 T1591 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Disconnected type None
[junit4:junit4]   2> 16749 T1617 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   2> 16828 T1617 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   2> 16831 T1617 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4]   2> 16843 T1617 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4]   2> 17436 T1617 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   2> 17448 T1617 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4]   2> 17453 T1617 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4]   2> 17481 T1617 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17486 T1617 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4]   2> 17492 T1617 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17494 T1617 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   2> 17496 T1617 oasc.SolrCore.<init> [collection1] Opening new SolrCore at solr/collection1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/
[junit4:junit4]   2> 17497 T1617 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@51f21c50
[junit4:junit4]   2> 17497 T1617 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   2> 17498 T1617 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3 forceNew:false
[junit4:junit4]   2> 17498 T1617 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3
[junit4:junit4]   2> 17499 T1617 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index/
[junit4:junit4]   2> 17499 T1617 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index' doesn't exist. Creating new index...
[junit4:junit4]   2> 17499 T1617 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index forceNew:false
[junit4:junit4]   2> 17501 T1617 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@553d0a33 lockFactory=org.apache.lucene.store.NativeFSLockFactory@549e7296)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4]   2> 17502 T1617 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4]   2> 17503 T1617 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index
[junit4:junit4]   2> 17503 T1617 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4]   2> 17505 T1617 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   2> 17505 T1617 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4]   2> 17506 T1617 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   2> 17506 T1617 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4]   2> 17507 T1617 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   2> 17507 T1617 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   2> 17507 T1617 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4]   2> 17508 T1617 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4]   2> 17508 T1617 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4]   2> 17509 T1617 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4]   2> 17509 T1617 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4]   2> 17509 T1617 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   2> 17510 T1617 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4]   2> 17510 T1617 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4]   2> 17510 T1617 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4]   2> 17511 T1617 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4]   2> 17511 T1617 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17512 T1617 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17512 T1617 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17513 T1617 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17513 T1617 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17514 T1617 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17514 T1617 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17514 T1617 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4]   2> 17515 T1617 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4]   2> 17515 T1617 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4]   2> 17519 T1617 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4]   2> 17523 T1617 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4]   2> 17525 T1617 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT]
[junit4:junit4]   2> 17529 T1617 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3
[junit4:junit4]   2> 17530 T1617 oass.SolrIndexSearcher.<init> Opening Searcher@4e70a141 main
[junit4:junit4]   2> 17530 T1617 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4]   2> 17531 T1617 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4]   2> 17531 T1617 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4]   2> 17533 T1617 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4]   2> 17552 T1618 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e70a141 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   2> 17556 T1617 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 17557 T1617 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 17710 T1615 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 17719 T1615 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":null,
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"192.168.57.17:8983_solr",
[junit4:junit4]   2> 	  "base_url":"http://192.168.57.17:8983/solr"}
[junit4:junit4]   2> 17720 T1615 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4]   2> 17720 T1615 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4]   2> 17726 T1614 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 18101 T1590 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 18102 T1590 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 18102 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49940
[junit4:junit4]   2> 18103 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to renew session 0x13bde6583d50003 at /127.0.0.1:49940
[junit4:junit4]   2> 18103 T1580 oazs.ZooKeeperServer.finishSessionInit Invalid session 0x13bde6583d50003 for client /127.0.0.1:49940, probably expired
[junit4:junit4]   2> 18103 T1590 oaz.ClientCnxn$SendThread.run Unable to reconnect to ZooKeeper service, session 0x13bde6583d50003 has expired, closing socket connection
[junit4:junit4]   2> 18103 T1591 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ccb457c name:ZooKeeperConnection Watcher:127.0.0.1:49927/solr got event WatchedEvent state:Expired type:None path:null path:null type:None
[junit4:junit4]   2> 18103 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49940 which had sessionid 0x13bde6583d50003
[junit4:junit4]   2> 18103 T1591 oascc.ConnectionManager.process Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4:junit4]   2> 18104 T1591 oascc.DefaultConnectionStrategy.reconnect Connection expired - starting a new one...
[junit4:junit4]   2> 18104 T1591 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49927/solr sessionTimeout=3000 watcher=org.apache.solr.common.cloud.ConnectionManager@1ccb457c
[junit4:junit4]   2> 18105 T1591 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 18105 T1619 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server 127.0.0.1/127.0.0.1:49927. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4]   2> 18106 T1619 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:49927, initiating session
[junit4:junit4]   2> 18106 T1580 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:49941
[junit4:junit4]   2> 18107 T1580 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:49941
[junit4:junit4]   2> 18108 T1584 oazs.ZooKeeperServer.finishSessionInit Established session 0x13bde6583d5000b with negotiated timeout 3000 for client /127.0.0.1:49941
[junit4:junit4]   2> 18108 T1619 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server 127.0.0.1/127.0.0.1:49927, sessionid = 0x13bde6583d5000b, negotiated timeout = 3000
[junit4:junit4]   2> 18109 T1620 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ccb457c name:ZooKeeperConnection Watcher:127.0.0.1:49927/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 18109 T1591 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 18109 T1591 oascc.ConnectionManager$1.update Connection with ZooKeeper reestablished.
[junit4:junit4]   2> 18110 T1591 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4]   2> 18110 T1591 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 18205 T1592 oasc.Overseer$ClusterStateUpdater.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 18205 T1593 oasc.OverseerCollectionProcessor.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 18235 T1615 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18236 T1615 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 18243 T1614 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 18560 T1617 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4]   2> 18560 T1617 oasc.ZkController.register Register replica - core:collection1 address:http://192.168.57.17:8983/solr collection:collection1 shard:shard1
[junit4:junit4]   2> 18564 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:delete cxid:0x7a zxid:0xac txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 18565 T1617 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4]   2> 18566 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:create cxid:0x7b zxid:0xad txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 18569 T1617 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=179999
[junit4:junit4]   2> 18751 T1615 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 18757 T1614 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 38706 T1617 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=159862
[junit4:junit4]   2> 48211 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 58873 T1617 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=139695
[junit4:junit4]   2> 79020 T1617 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=119548
[junit4:junit4]   2> 80303 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 99172 T1617 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=99396
[junit4:junit4]   2> 112389 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 119295 T1617 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=79273
[junit4:junit4]   2> 139431 T1617 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=59137
[junit4:junit4]   2> 144468 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 159568 T1617 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=39000
[junit4:junit4]   2> 176547 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: Could not get leader props
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:789)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leaders/shard1
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:253)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:250)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:767)
[junit4:junit4]   2> 		... 10 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 179668 T1617 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=4 found=1 timeoutin=18900
[junit4:junit4]   2> 198772 T1617 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Was waiting for replicas to come up, but they are taking too long - assuming they won't come back till later
[junit4:junit4]   2> 198772 T1617 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4]   2> 198773 T1617 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://192.168.57.17:8983/solr/collection1/
[junit4:junit4]   2> 198773 T1617 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 198779 T1585 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13bde6583d5000a type:create cxid:0x627 zxid:0xb4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 199280 T1615 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 199289 T1614 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 199347 T1617 oasc.ZkController.register We are http://192.168.57.17:8983/solr/collection1/ and leader is http://192.168.57.17:8983/solr/collection1/
[junit4:junit4]   2> 199348 T1617 oasc.ZkController.checkRecovery WARNING Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4:junit4]   2> 199348 T1617 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4]   2> 199348 T1617 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 199351 T1617 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 199606 T1591 oasc.ZkController.publish publishing core=testcore state=down
[junit4:junit4]   2> 199606 T1591 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4]   2> 199798 T1615 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 199799 T1615 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "core":"collection1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"192.168.57.17:8983_solr",
[junit4:junit4]   2> 	  "base_url":"http://192.168.57.17:8983/solr"}
[junit4:junit4]   2> 199805 T1615 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "numShards":null,
[junit4:junit4]   2> 	  "shard":"shard1",
[junit4:junit4]   2> 	  "roles":null,
[junit4:junit4]   2> 	  "state":"down",
[junit4:junit4]   2> 	  "core":"testcore",
[junit4:junit4]   2> 	  "collection":"testcore",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1:1661_solr",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1:1661/solr"}
[junit4:junit4]   2> 199811 T1614 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 219677 T1578 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1998953417
[junit4:junit4]   2> 219678 T1578 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@9d0a3e
[junit4:junit4]   2> 219687 T1578 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 219687 T1578 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 219688 T1578 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 219688 T1578 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 219689 T1578 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 219690 T1578 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1/index
[junit4:junit4]   2> 219691 T1578 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1/index
[junit4:junit4]   2> 219691 T1578 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1/index
[junit4:junit4]   2> 219692 T1578 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1
[junit4:junit4]   2> 219693 T1578 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data1
[junit4:junit4]   2> 219694 T1578 oasc.SolrCore.close [testcore]  CLOSING SolrCore org.apache.solr.core.SolrCore@2ff175d
[junit4:junit4]   2> 219706 T1578 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 219707 T1578 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 219708 T1578 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 219708 T1578 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 219709 T1578 oasc.SolrCore.closeSearcher [testcore] Closing main searcher on request.
[junit4:junit4]   2> 219710 T1578 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4/index
[junit4:junit4]   2> 219711 T1578 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4
[junit4:junit4]   2> 219711 T1578 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4
[junit4:junit4]   2> 219712 T1578 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4/index
[junit4:junit4]   2> 219713 T1578 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data4/index
[junit4:junit4]   2> 219716 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d5000b
[junit4:junit4]   2> 219718 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49941 which had sessionid 0x13bde6583d5000b
[junit4:junit4]   2> 219718 T1578 oaz.ZooKeeper.close Session: 0x13bde6583d5000b closed
[junit4:junit4]   2> 219719 T1620 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 219719 T1578 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1191005881
[junit4:junit4]   2> 219721 T1578 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@e5d2d9b
[junit4:junit4]   2> 219743 T1578 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4]   2> 219744 T1578 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4]   2> 219744 T1578 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4]   2> 219744 T1578 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4]   2> 219745 T1578 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4]   2> 219746 T1578 oasc.CachingDirectoryFactory.close Releasing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index
[junit4:junit4]   2> 219746 T1578 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3
[junit4:junit4]   2> 219746 T1578 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3
[junit4:junit4]   2> 219747 T1578 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index
[junit4:junit4]   2> 219747 T1578 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ClusterStateUpdateTest-1356645893068/data3/index
[junit4:junit4]   2> 219750 T1615 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88909145248694282-192.168.57.17:8983_solr-n_0000000003) am no longer a leader.
[junit4:junit4]   2> 219754 T1585 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13bde6583d5000a
[junit4:junit4]   2> 219755 T1580 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:49939 which had sessionid 0x13bde6583d5000a
[junit4:junit4]   2> 219755 T1614 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   2> 219756 T1614 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 219755 T1578 oaz.ZooKeeper.close Session: 0x13bde6583d5000a closed
[junit4:junit4]   2> 219756 T1614 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 219756 T1614 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 219756 T1578 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=184616510
[junit4:junit4]   2> 219757 T1578 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 219757 T1578 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 219757 T1578 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 219758 T1585 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 219758 T1578 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 219761 T1584 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 219761 T1578 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 219940 T1583 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 219997 T1578 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49927 49927
[junit4:junit4]   2> 220029 T1580 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 220032 T1578 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4]   2> 220033 T1578 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4]   2> 220034 T1578 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 220034 T1578 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4]   2> 220035 T1578 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 220036 T1578 oas.SolrTestCaseJ4.tearDown ###Ending testCoreRegistration
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ClusterStateUpdateTest -Dtests.method=testCoreRegistration -Dtests.seed=3DDDBCDA3FA3E83C -Dtests.slow=true -Dtests.locale=cs -Dtests.timezone=Europe/Paris -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  220s | ClusterStateUpdateTest.testCoreRegistration <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([3DDDBCDA3FA3E83C:8356DA7546D9E609]:0)
[junit4:junit4]    > 	at org.junit.Assert.fail(Assert.java:92)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4]    > 	at org.junit.Assert.assertTrue(Assert.java:54)
[junit4:junit4]    > 	at org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterStateUpdateTest.java:234)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4]    > 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit4:junit4]    > 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit4:junit4]    > 	at java.lang.reflect.Method.invoke(Method.java:597)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4]    > 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4]    > 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4]    > 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:680)
[junit4:junit4]   2> 220056 T1578 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> 220085 T1577 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4]   2> 220674 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 223679 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 226695 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 229708 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 232727 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 235736 T1591 oasc.SolrException.log SEVERE There was a problem finding the leader in zk:org.apache.solr.common.SolrException: CoreContainer is shutdown
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:786)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:753)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1169)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 237739 T1591 oasc.SolrException.log SEVERE :org.apache.solr.common.SolrException: There was a problem finding the leader in zk
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.waitForLeaderToSeeDownState(ZkController.java:1179)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.registerAllCoresAsDown(ZkController.java:277)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController.access$100(ZkController.java:85)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:193)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 237740 T1591 oasc.SolrException.log SEVERE :org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election/88909145248694283-127.0.0.1:1661_solr-n_
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:293)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:220)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:197)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	
[junit4:junit4]   2> 237741 T1591 oasc.SolrException.log SEVERE Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException: 
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:225)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:117)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:46)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:91)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election/88909145248694283-127.0.0.1:1661_solr-n_
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4]   2> 		at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4:junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:293)
[junit4:junit4]   2> 		at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:220)
[junit4:junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:197)
[junit4:junit4]   2> 		... 5 more
[junit4:junit4]   2> 	
[junit4:junit4]   2> 237741 T1591 oascc.DefaultConnectionStrategy.reconnect Reconnect to ZooKeeper failed
[junit4:junit4]   2> 237741 T1591 oascc.ConnectionManager.process Connected:true
[junit4:junit4]   2> 237742 T1591 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: null state: Expired type None
[junit4:junit4]   2> 237742 T1591 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=cs, timezone=Europe/Paris
[junit4:junit4]   2> NOTE: Mac OS X 10.8.2 x86_64/Apple Inc. 1.6.0_37 (64-bit)/cpus=2,threads=1,free=37658744,total=134520832
[junit4:junit4]   2> NOTE: All tests run in this JVM: [CollectionsAPIDistributedZkTest, SuggesterTSTTest, SolrPluginUtilsTest, ScriptEngineTest, AlternateDirectoryTest, BasicDistributedZkTest, ZkCLITest, TestRTGBase, SuggesterWFSTTest, TestWriterPerf, TestLRUCache, OverseerCollectionProcessorTest, TestTrie, TestSearchPerf, SOLR749Test, TestSolrJ, DefaultValueUpdateProcessorTest, TestStressReorder, SpatialFilterTest, TestExtendedDismaxParser, LeaderElectionIntegrationTest, DocumentBuilderTest, TestQuerySenderNoQuery, UpdateRequestProcessorFactoryTest, ConvertedLegacyTest, HighlighterTest, TestLMDirichletSimilarityFactory, TestLuceneMatchVersion, TestConfig, SolrInfoMBeanTest, TestSolrDeletionPolicy2, CacheHeaderTest, TestOmitPositions, FullSolrCloudDistribCmdsTest, RAMDirectoryFactoryTest, OverseerTest, NotRequiredUniqueKeyTest, TestAnalyzedSuggestions, ClusterStateUpdateTest]
[junit4:junit4] Completed in 237.92s, 1 test, 1 failure <<< FAILURES!

[...truncated 620 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:353: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:178: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:438: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1176: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:841: There were test failures: 243 suites, 1009 tests, 1 failure, 13 ignored (2 assumptions)

Total time: 60 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.6.0 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure



RE: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 5 - Still Failing!

Posted by Uwe Schindler <uw...@thetaphi.de>.
Should be fixed now (problem was that /usr/local/bin was not in path when Jenkins starts the slave, because Jenkins startup does not eval /etc/profile).

-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: uwe@thetaphi.de

> -----Original Message-----
> From: Policeman Jenkins Server [mailto:jenkins@sd-datasolutions.de]
> Sent: Thursday, December 27, 2012 8:59 PM
> To: dev@lucene.apache.org
> Subject: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 5 -
> Still Failing!
> 
> Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/5/
> Java: 64bit/jdk1.7.0 -XX:+UseConcMarkSweepGC
> 
> All tests passed
> 
> Build Log:
> [...truncated 26169 lines...]
> BUILD FAILED
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/build.xml:60: The following error occurred while executing this line:
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/lucene/build.xml:242: The following error occurred while executing
> this line:
> /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/lucene/common-build.xml:1946: Execute failed:
> java.io.IOException: Cannot run program "python3.2" (in directory
> "/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-
> MacOSX/lucene"): error=2, No such file or directory
> 	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
> 	at java.lang.Runtime.exec(Runtime.java:615)
> 	at
> org.apache.tools.ant.taskdefs.Execute$Java13CommandLauncher.exec(Exec
> ute.java:862)
> 	at org.apache.tools.ant.taskdefs.Execute.launch(Execute.java:481)
> 	at org.apache.tools.ant.taskdefs.Execute.execute(Execute.java:495)
> 	at
> org.apache.tools.ant.taskdefs.ExecTask.runExecute(ExecTask.java:631)
> 	at
> org.apache.tools.ant.taskdefs.ExecTask.runExec(ExecTask.java:672)
> 	at
> org.apache.tools.ant.taskdefs.ExecTask.execute(ExecTask.java:498)
> 	at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
> 	at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> 	at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> 	at org.apache.tools.ant.Task.perform(Task.java:348)
> 	at
> org.apache.tools.ant.taskdefs.Sequential.execute(Sequential.java:68)
> 	at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
> 	at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> 	at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> 	at org.apache.tools.ant.Task.perform(Task.java:348)
> 	at
> org.apache.tools.ant.taskdefs.MacroInstance.execute(MacroInstance.java:3
> 98)
> 	at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
> 	at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> 	at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> 	at org.apache.tools.ant.Task.perform(Task.java:348)
> 	at org.apache.tools.ant.Target.execute(Target.java:390)
> 	at org.apache.tools.ant.Target.performTasks(Target.java:411)
> 	at
> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399)
> 	at
> org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleChe
> ckExecutor.java:38)
> 	at org.apache.tools.ant.Project.executeTargets(Project.java:1251)
> 	at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442)
> 	at org.apache.tools.ant.taskdefs.SubAnt.execute(SubAnt.java:302)
> 	at org.apache.tools.ant.taskdefs.SubAnt.execute(SubAnt.java:221)
> 	at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
> 	at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
> 	at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
> sorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
> 	at org.apache.tools.ant.Task.perform(Task.java:348)
> 	at org.apache.tools.ant.Target.execute(Target.java:390)
> 	at org.apache.tools.ant.Target.performTasks(Target.java:411)
> 	at
> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399)
> 	at org.apache.tools.ant.Project.executeTarget(Project.java:1368)
> 	at
> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecut
> or.java:41)
> 	at org.apache.tools.ant.Project.executeTargets(Project.java:1251)
> 	at org.apache.tools.ant.Main.runBuild(Main.java:809)
> 	at org.apache.tools.ant.Main.startAnt(Main.java:217)
> 	at org.apache.tools.ant.launch.Launcher.run(Launcher.java:280)
> 	at org.apache.tools.ant.launch.Launcher.main(Launcher.java:109)
> Caused by: java.io.IOException: error=2, No such file or directory
> 	at java.lang.UNIXProcess.forkAndExec(Native Method)
> 	at java.lang.UNIXProcess.<init>(UNIXProcess.java:135)
> 	at java.lang.ProcessImpl.start(ProcessImpl.java:130)
> 	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1021)
> 	... 51 more
> 
> Total time: 73 minutes 6 seconds
> Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording
> test results Description set: Java: 64bit/jdk1.7.0 -XX:+UseConcMarkSweepGC
> Email was triggered for: Failure Sending email for trigger: Failure
> 



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 5 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/5/
Java: 64bit/jdk1.7.0 -XX:+UseConcMarkSweepGC

All tests passed

Build Log:
[...truncated 26169 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:60: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build.xml:242: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1946: Execute failed: java.io.IOException: Cannot run program "python3.2" (in directory "/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene"): error=2, No such file or directory
	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
	at java.lang.Runtime.exec(Runtime.java:615)
	at org.apache.tools.ant.taskdefs.Execute$Java13CommandLauncher.exec(Execute.java:862)
	at org.apache.tools.ant.taskdefs.Execute.launch(Execute.java:481)
	at org.apache.tools.ant.taskdefs.Execute.execute(Execute.java:495)
	at org.apache.tools.ant.taskdefs.ExecTask.runExecute(ExecTask.java:631)
	at org.apache.tools.ant.taskdefs.ExecTask.runExec(ExecTask.java:672)
	at org.apache.tools.ant.taskdefs.ExecTask.execute(ExecTask.java:498)
	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
	at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
	at org.apache.tools.ant.Task.perform(Task.java:348)
	at org.apache.tools.ant.taskdefs.Sequential.execute(Sequential.java:68)
	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
	at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
	at org.apache.tools.ant.Task.perform(Task.java:348)
	at org.apache.tools.ant.taskdefs.MacroInstance.execute(MacroInstance.java:398)
	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
	at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
	at org.apache.tools.ant.Task.perform(Task.java:348)
	at org.apache.tools.ant.Target.execute(Target.java:390)
	at org.apache.tools.ant.Target.performTasks(Target.java:411)
	at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399)
	at org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
	at org.apache.tools.ant.Project.executeTargets(Project.java:1251)
	at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442)
	at org.apache.tools.ant.taskdefs.SubAnt.execute(SubAnt.java:302)
	at org.apache.tools.ant.taskdefs.SubAnt.execute(SubAnt.java:221)
	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
	at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
	at org.apache.tools.ant.Task.perform(Task.java:348)
	at org.apache.tools.ant.Target.execute(Target.java:390)
	at org.apache.tools.ant.Target.performTasks(Target.java:411)
	at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399)
	at org.apache.tools.ant.Project.executeTarget(Project.java:1368)
	at org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
	at org.apache.tools.ant.Project.executeTargets(Project.java:1251)
	at org.apache.tools.ant.Main.runBuild(Main.java:809)
	at org.apache.tools.ant.Main.startAnt(Main.java:217)
	at org.apache.tools.ant.launch.Launcher.run(Launcher.java:280)
	at org.apache.tools.ant.launch.Launcher.main(Launcher.java:109)
Caused by: java.io.IOException: error=2, No such file or directory
	at java.lang.UNIXProcess.forkAndExec(Native Method)
	at java.lang.UNIXProcess.<init>(UNIXProcess.java:135)
	at java.lang.ProcessImpl.start(ProcessImpl.java:130)
	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1021)
	... 51 more

Total time: 73 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.7.0 -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.6.0) - Build # 2 - Still Failing!

Posted by Policeman Jenkins Server <je...@sd-datasolutions.de>.
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-MacOSX/2/
Java: 64bit/jdk1.6.0 -XX:+UseSerialGC

No tests ran.

Build Log:
[...truncated 75 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:353: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/build.xml:50: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:330: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:367: Ivy is not available

Total time: 3 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 64bit/jdk1.6.0 -XX:+UseSerialGC
Email was triggered for: Failure
Sending email for trigger: Failure