You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/02/27 17:26:28 UTC
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1913 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1913/
All tests passed
Build Log:
[...truncated 28417 lines...]
check-licenses:
[echo] License check under: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr
[licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jcl-over-slf4j-1.6.6.jar
[licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jcl-over-slf4j-1.6.6.jar.sha1
[licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jul-to-slf4j-1.6.6.jar
[licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jul-to-slf4j-1.6.6.jar.sha1
[licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/slf4j-api-1.6.6.jar
[licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/slf4j-api-1.6.6.jar.sha1
[...truncated 3 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:471: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:64: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:254: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/tools/custom-tasks.xml:62: License check failed. Check the logs.
Total time: 108 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1916 - Still Failing
Posted by Robert Muir <rc...@gmail.com>.
Thanks Mark!
On Sun, Mar 2, 2014 at 11:45 AM, Mark Miller <ma...@gmail.com> wrote:
> I just tried zapping the workspace for that job.
>
> - Mark
>
> http://about.me/markrmiller
>
> On Mar 2, 2014, at 11:44 AM, Mark Miller <ma...@gmail.com> wrote:
>
>> Yeah, I was just trying to figure this out too - best I can tell, that check out is in a bad state.
>>
>> - Mark
>>
>> http://about.me/markrmiller
>>
>> On Mar 2, 2014, at 11:14 AM, Robert Muir <rc...@gmail.com> wrote:
>>
>>> I think this one needs a clean-jars or similar on the workspace?
>>>
>>>
>>> On Sun, Mar 2, 2014 at 11:11 AM, Apache Jenkins Server
>>> <je...@builds.apache.org> wrote:
>>>> Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1916/
>>>>
>>>> All tests passed
>>>>
>>>> Build Log:
>>>> [...truncated 28344 lines...]
>>>> check-licenses:
>>>> [echo] License check under: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr
>>>> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jcl-over-slf4j-1.6.6.jar
>>>> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jcl-over-slf4j-1.6.6.jar.sha1
>>>>
>>>> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jul-to-slf4j-1.6.6.jar
>>>> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jul-to-slf4j-1.6.6.jar.sha1
>>>> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/slf4j-api-1.6.6.jar
>>>> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/slf4j-api-1.6.6.jar.sha1
>>>>
>>>> [...truncated 3 lines...]
>>>> BUILD FAILED
>>>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:471: The following error occurred while executing this line:
>>>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:64: The following error occurred while executing this line:
>>>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:254: The following error occurred while executing this line:
>>>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/tools/custom-tasks.xml:62: License check failed. Check the logs.
>>>>
>>>> Total time: 111 minutes 2 seconds
>>>> Build step 'Invoke Ant' marked build as failure
>>>> Archiving artifacts
>>>> Recording test results
>>>> Email was triggered for: Failure
>>>> Sending email for trigger: Failure
>>>>
>>>>
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>>
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1916 - Still Failing
Posted by Mark Miller <ma...@gmail.com>.
I just tried zapping the workspace for that job.
- Mark
http://about.me/markrmiller
On Mar 2, 2014, at 11:44 AM, Mark Miller <ma...@gmail.com> wrote:
> Yeah, I was just trying to figure this out too - best I can tell, that check out is in a bad state.
>
> - Mark
>
> http://about.me/markrmiller
>
> On Mar 2, 2014, at 11:14 AM, Robert Muir <rc...@gmail.com> wrote:
>
>> I think this one needs a clean-jars or similar on the workspace?
>>
>>
>> On Sun, Mar 2, 2014 at 11:11 AM, Apache Jenkins Server
>> <je...@builds.apache.org> wrote:
>>> Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1916/
>>>
>>> All tests passed
>>>
>>> Build Log:
>>> [...truncated 28344 lines...]
>>> check-licenses:
>>> [echo] License check under: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr
>>> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jcl-over-slf4j-1.6.6.jar
>>> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jcl-over-slf4j-1.6.6.jar.sha1
>>>
>>> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jul-to-slf4j-1.6.6.jar
>>> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jul-to-slf4j-1.6.6.jar.sha1
>>> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/slf4j-api-1.6.6.jar
>>> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/slf4j-api-1.6.6.jar.sha1
>>>
>>> [...truncated 3 lines...]
>>> BUILD FAILED
>>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:471: The following error occurred while executing this line:
>>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:64: The following error occurred while executing this line:
>>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:254: The following error occurred while executing this line:
>>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/tools/custom-tasks.xml:62: License check failed. Check the logs.
>>>
>>> Total time: 111 minutes 2 seconds
>>> Build step 'Invoke Ant' marked build as failure
>>> Archiving artifacts
>>> Recording test results
>>> Email was triggered for: Failure
>>> Sending email for trigger: Failure
>>>
>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1916 - Still Failing
Posted by Mark Miller <ma...@gmail.com>.
Yeah, I was just trying to figure this out too - best I can tell, that check out is in a bad state.
- Mark
http://about.me/markrmiller
On Mar 2, 2014, at 11:14 AM, Robert Muir <rc...@gmail.com> wrote:
> I think this one needs a clean-jars or similar on the workspace?
>
>
> On Sun, Mar 2, 2014 at 11:11 AM, Apache Jenkins Server
> <je...@builds.apache.org> wrote:
>> Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1916/
>>
>> All tests passed
>>
>> Build Log:
>> [...truncated 28344 lines...]
>> check-licenses:
>> [echo] License check under: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr
>> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jcl-over-slf4j-1.6.6.jar
>> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jcl-over-slf4j-1.6.6.jar.sha1
>>
>> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jul-to-slf4j-1.6.6.jar
>> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jul-to-slf4j-1.6.6.jar.sha1
>> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/slf4j-api-1.6.6.jar
>> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/slf4j-api-1.6.6.jar.sha1
>>
>> [...truncated 3 lines...]
>> BUILD FAILED
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:471: The following error occurred while executing this line:
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:64: The following error occurred while executing this line:
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:254: The following error occurred while executing this line:
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/tools/custom-tasks.xml:62: License check failed. Check the logs.
>>
>> Total time: 111 minutes 2 seconds
>> Build step 'Invoke Ant' marked build as failure
>> Archiving artifacts
>> Recording test results
>> Email was triggered for: Failure
>> Sending email for trigger: Failure
>>
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1916 - Still Failing
Posted by Robert Muir <rc...@gmail.com>.
I think this one needs a clean-jars or similar on the workspace?
On Sun, Mar 2, 2014 at 11:11 AM, Apache Jenkins Server
<je...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1916/
>
> All tests passed
>
> Build Log:
> [...truncated 28344 lines...]
> check-licenses:
> [echo] License check under: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr
> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jcl-over-slf4j-1.6.6.jar
> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jcl-over-slf4j-1.6.6.jar.sha1
>
> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jul-to-slf4j-1.6.6.jar
> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jul-to-slf4j-1.6.6.jar.sha1
> [licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/slf4j-api-1.6.6.jar
> [licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/slf4j-api-1.6.6.jar.sha1
>
> [...truncated 3 lines...]
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:471: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:64: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:254: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/tools/custom-tasks.xml:62: License check failed. Check the logs.
>
> Total time: 111 minutes 2 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1916 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1916/
All tests passed
Build Log:
[...truncated 28344 lines...]
check-licenses:
[echo] License check under: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr
[licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jcl-over-slf4j-1.6.6.jar
[licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jcl-over-slf4j-1.6.6.jar.sha1
[licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jul-to-slf4j-1.6.6.jar
[licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jul-to-slf4j-1.6.6.jar.sha1
[licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/slf4j-api-1.6.6.jar
[licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/slf4j-api-1.6.6.jar.sha1
[...truncated 3 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:471: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:64: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:254: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/tools/custom-tasks.xml:62: License check failed. Check the logs.
Total time: 111 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1915 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1915/
All tests passed
Build Log:
[...truncated 28367 lines...]
check-licenses:
[echo] License check under: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr
[licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jcl-over-slf4j-1.6.6.jar
[licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jcl-over-slf4j-1.6.6.jar.sha1
[licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/jul-to-slf4j-1.6.6.jar
[licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/jul-to-slf4j-1.6.6.jar.sha1
[licenses] MISSING sha1 checksum file for: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/example/lib/ext/slf4j-api-1.6.6.jar
[licenses] EXPECTED sha1 checksum file : /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/licenses/slf4j-api-1.6.6.jar.sha1
[...truncated 3 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:471: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:64: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:254: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/tools/custom-tasks.xml:62: License check failed. Check the logs.
Total time: 103 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1914 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1914/
1 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
Stack Trace:
org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at __randomizedtesting.SeedInfo.seed([9F02B25F17FA0C85:9B0A3DAC055FE3A4]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:429)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:426)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:383)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:370)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:156)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:154)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:590)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 10218 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4] 2> 127058 T368 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 127059 T368 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-OverseerTest-1393611306913
[junit4] 2> 127060 T368 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 127066 T368 oas.SolrTestCaseJ4.setUp ###Starting testOverseerFailure
[junit4] 2> 127067 T368 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 127067 T369 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 127168 T368 oasc.ZkTestServer.run start zk server on port:14056
[junit4] 2> 127169 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 127201 T375 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@129ace22 name:ZooKeeperConnection Watcher:127.0.0.1:14056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 127201 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 127202 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 127205 T377 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@365d1fe2 name:ZooKeeperConnection Watcher:127.0.0.1:14056 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 127206 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 127215 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 127218 T379 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@267e5d35 name:ZooKeeperConnection Watcher:127.0.0.1:14056 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 127219 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 127219 T368 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 127223 T368 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 127233 T368 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 127236 T368 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 127238 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 127242 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 127244 T381 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21065fec name:ZooKeeperConnection Watcher:127.0.0.1:14056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 127245 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 127246 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 127249 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 127252 T381 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 127252 T375 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 127253 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 127255 T383 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a0a925d name:ZooKeeperConnection Watcher:127.0.0.1:14056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 127255 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 127257 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 127259 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 127271 T368 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:14056_solr
[junit4] 2> 127272 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 127275 T368 oasc.Overseer.start Overseer (id=91331710610964484-127.0.0.1:14056_solr-n_0000000000) starting
[junit4] 2> 127284 T368 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 127288 T368 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 127292 T368 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 127296 T385 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 127297 T385 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 127297 T384 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 128299 T383 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 128301 T384 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 128302 T384 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 128303 T384 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 128303 T384 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 128312 T383 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 128314 T381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 128314 T375 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 128800 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 128828 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 128835 T383 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 128836 T368 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 128837 T384 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 128840 T383 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 128840 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 128842 T384 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 128843 T384 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 128846 T383 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 128949 T375 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 128951 T381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 130008 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 130036 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130039 T387 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4befe1a1 name:ZooKeeperConnection Watcher:127.0.0.1:14056/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130039 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130051 T368 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:14056_solr
[junit4] 2> 130051 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 130054 T368 oasc.Overseer.start Overseer (id=91331710610964485-127.0.0.1:14056_solr-n_0000000001) starting
[junit4] 2> 130071 T389 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 130072 T389 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 130072 T388 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 130075 T388 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 130076 T388 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 130076 T388 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
[junit4] 2> 130080 T387 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 130081 T381 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 130081 T375 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 130137 T387 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 130137 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 130139 T388 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 130152 T368 oasc.LeaderElector.checkIfIamLeader WARN Failed setting watch org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election/91331710610964483-node1_core1-n_0000000002
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:271)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:271)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
[junit4] 2> at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:154)
[junit4] 2> at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:590)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2>
[junit4] 2> 130161 T381 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 130163 T388 oasc.SolrException.log ERROR Problem cleaning up collection in zk:collection1:org.apache.zookeeper.KeeperException$NotEmptyException: KeeperErrorCode = Directory not empty for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:125)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:633)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:628)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:628)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:628)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.removeCore(Overseer.java:949)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.processMessage(Overseer.java:235)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:192)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2>
[junit4] 2> 130163 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 130174 T387 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 130177 T387 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 130177 T375 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 130181 T368 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:14056 14056
[junit4] 2> 130255 T368 oas.SolrTestCaseJ4.tearDown ###Ending testOverseerFailure
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=OverseerTest -Dtests.method=testOverseerFailure -Dtests.seed=9F02B25F17FA0C85 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=da -Dtests.timezone=EAT -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 3.26s J0 | OverseerTest.testOverseerFailure <<<
[junit4] > Throwable #1: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
[junit4] > at __randomizedtesting.SeedInfo.seed([9F02B25F17FA0C85:9B0A3DAC055FE3A4]:0)
[junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
[junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:429)
[junit4] > at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:426)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:383)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:370)
[junit4] > at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] > at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] > at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:156)
[junit4] > at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
[junit4] > at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:154)
[junit4] > at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:590)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] 2> 130330 T368 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4] 2> 130330 T368 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 130331 T390 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 130432 T368 oasc.ZkTestServer.run start zk server on port:41651
[junit4] 2> 130433 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130439 T396 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57fe2b6 name:ZooKeeperConnection Watcher:127.0.0.1:41651 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130440 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130493 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130501 T398 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b4985d2 name:ZooKeeperConnection Watcher:127.0.0.1:41651 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130501 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130502 T368 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 130506 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130515 T400 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c325a3b name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130515 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130516 T368 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 130519 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130521 T402 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45d7d580 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130521 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130523 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 130526 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 130531 T368 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:41651_solr
[junit4] 2> 130531 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 130534 T368 oasc.Overseer.start Overseer (id=91331710825070595-127.0.0.1:41651_solr-n_0000000000) starting
[junit4] 2> 130537 T368 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 130541 T368 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 130545 T368 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 130548 T404 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 130549 T368 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 130549 T404 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 130549 T403 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 130553 T368 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 130563 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130566 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130569 T406 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b1451ed name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130569 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130571 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130574 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4] 2> 130577 T400 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 130577 T406 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4] 2> 130578 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130580 T408 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a71217a name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130580 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130582 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130585 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4] 2> 130588 T408 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 130588 T406 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 130588 T400 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 130589 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130591 T410 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1209739c name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130591 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130593 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130596 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4] 2> 130599 T406 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 130600 T408 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 130599 T410 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 130599 T400 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 130600 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130603 T412 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@183b5819 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130603 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130605 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130607 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4] 2> 130611 T406 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 130611 T410 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 130611 T400 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 130611 T412 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 130611 T408 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 130612 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130614 T414 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bd33b15 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130614 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130616 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130619 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4] 2> 130622 T410 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 130622 T406 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 130622 T408 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 130622 T400 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 130622 T412 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 130622 T414 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 130623 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130625 T416 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c40a6f8 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130625 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130627 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130630 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4] 2> 130633 T400 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 130633 T412 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 130633 T408 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 130633 T410 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 130633 T406 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 130634 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130634 T414 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 130634 T416 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 130637 T418 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1db9b30c name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130637 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130639 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130641 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4] 2> 130645 T414 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 130645 T418 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 130645 T406 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 130646 T400 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 130645 T416 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 130645 T408 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 130645 T412 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 130645 T410 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 130646 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130648 T420 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61a05acb name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130649 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130650 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130653 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4] 2> 130657 T400 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 130657 T410 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 130657 T416 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 130658 T408 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 130657 T414 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 130657 T418 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 130657 T406 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 130657 T412 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 130657 T420 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4] 2> 130658 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130660 T422 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bf7a927 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130661 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130662 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130665 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4] 2> 130669 T408 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 130669 T412 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 130669 T400 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 130670 T422 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 130669 T410 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 130669 T414 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 130669 T406 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 130669 T418 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 130669 T416 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 130670 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130670 T420 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4] 2> 130673 T424 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ccefbbd name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130673 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130675 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130678 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4] 2> 130681 T416 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130682 T412 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130682 T424 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130682 T422 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130682 T406 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130682 T414 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130681 T408 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130681 T418 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130683 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130682 T420 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130682 T400 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130682 T410 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4] 2> 130685 T426 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6466fd34 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130686 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130688 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130690 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4] 2> 130694 T418 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130694 T416 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130694 T424 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130695 T410 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130695 T412 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130694 T408 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130695 T400 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130695 T420 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130695 T422 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130694 T414 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130694 T426 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130694 T406 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4] 2> 130696 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130698 T428 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3182afc9 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130699 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130700 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130703 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4] 2> 130707 T422 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130707 T424 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130708 T410 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130707 T420 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130708 T412 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130707 T428 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130707 T414 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130707 T400 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130709 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130708 T418 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130708 T416 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130708 T406 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130708 T408 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130708 T426 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4] 2> 130711 T430 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c2fe4e7 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130712 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130714 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130716 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4] 2> 130720 T424 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130720 T430 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130721 T412 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130721 T400 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130721 T422 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130720 T414 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130721 T418 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130720 T408 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130720 T406 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130720 T416 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130722 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130721 T410 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130721 T426 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130721 T428 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130721 T420 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4] 2> 130724 T432 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fecb886 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130725 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130727 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130729 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4] 2> 130733 T426 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130733 T412 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130734 T424 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130734 T418 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130734 T428 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130734 T410 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130734 T432 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130733 T420 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130735 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130735 T430 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130735 T406 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130734 T416 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130734 T414 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130734 T422 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130734 T408 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130734 T400 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4] 2> 130737 T434 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1672f0a6 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130739 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130740 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130743 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4] 2> 130747 T406 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130747 T426 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130748 T420 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130748 T410 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130748 T432 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130748 T414 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130748 T408 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130747 T424 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130747 T434 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130749 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130749 T428 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130749 T400 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130749 T422 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130748 T412 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130748 T430 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130748 T418 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130748 T416 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4] 2> 130751 T436 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@765746ca name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130753 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130754 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130757 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4] 2> 130761 T414 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130761 T422 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130762 T430 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130762 T406 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130762 T420 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130762 T434 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130762 T416 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130761 T428 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130761 T400 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130761 T424 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130761 T408 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130761 T436 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130763 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130763 T432 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130762 T410 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130762 T412 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130762 T418 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130762 T426 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4] 2> 130765 T438 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64862576 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130767 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130768 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130771 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4] 2> 130775 T432 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130776 T434 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130776 T422 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130776 T430 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130776 T424 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130777 T438 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130776 T418 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130776 T420 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130776 T410 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130776 T412 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130776 T406 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130776 T426 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130778 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130777 T408 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130780 T440 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12892419 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130777 T414 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130777 T428 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130777 T436 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130777 T416 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130777 T400 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4] 2> 130781 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130784 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130787 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4] 2> 130791 T406 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130791 T434 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130791 T418 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130792 T436 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130792 T420 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130792 T400 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130792 T424 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130793 T408 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130792 T428 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130792 T412 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130791 T410 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130791 T426 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130791 T432 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130791 T416 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130791 T440 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130795 T442 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68e6e00 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130793 T422 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130793 T430 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130792 T414 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130792 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130792 T438 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4] 2> 130797 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130799 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130802 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4] 2> 130806 T422 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130807 T436 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130807 T414 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130808 T420 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130808 T426 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130807 T438 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130807 T428 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130807 T430 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130807 T424 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130807 T400 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130809 T432 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130809 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130809 T440 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130808 T418 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130808 T406 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130808 T434 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130808 T416 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130808 T412 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130808 T410 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130808 T442 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130807 T408 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4] 2> 130811 T444 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@97d9475 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130813 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130815 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130818 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
[junit4] 2> 130822 T420 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130823 T426 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130823 T440 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130823 T434 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130824 T418 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130824 T438 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130824 T430 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130823 T406 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130823 T412 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130823 T442 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130823 T410 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130823 T432 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130823 T416 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130825 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130825 T444 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130825 T436 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130824 T408 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130824 T414 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130824 T424 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130824 T400 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130824 T422 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130824 T428 oascc.ZkStateReader$3.process Updating live nodes... (20)
[junit4] 2> 130828 T446 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3076f54c name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130831 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130834 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130837 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
[junit4] 2> 130842 T428 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130843 T444 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130843 T432 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130843 T412 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130843 T430 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130843 T438 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130844 T406 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130842 T424 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130842 T400 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130845 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130844 T446 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130844 T434 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130844 T410 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130844 T416 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130844 T420 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130844 T414 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130844 T418 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130844 T442 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130843 T440 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130843 T436 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130843 T408 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130843 T422 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130843 T426 oascc.ZkStateReader$3.process Updating live nodes... (21)
[junit4] 2> 130848 T448 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a40ce0a name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130850 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130852 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130855 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
[junit4] 2> 130859 T446 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130860 T410 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130860 T420 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130860 T416 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130860 T440 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130860 T418 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130859 T406 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130859 T448 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130859 T434 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130862 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130862 T428 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130861 T430 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130861 T400 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130861 T424 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130861 T422 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130861 T436 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130861 T408 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130861 T438 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130861 T444 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130861 T414 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130861 T432 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130860 T412 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130860 T442 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130860 T426 oascc.ZkStateReader$3.process Updating live nodes... (22)
[junit4] 2> 130865 T450 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c4b88a5 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130868 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130869 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130872 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
[junit4] 2> 130877 T406 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130877 T416 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T408 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T422 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T432 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130879 T444 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130879 T420 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130877 T446 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130879 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130877 T426 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130877 T448 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130877 T450 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130877 T434 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130877 T418 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130879 T410 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130882 T452 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16d11a0e name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130879 T412 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130879 T430 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T440 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T436 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T414 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T442 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T400 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T428 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T424 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130878 T438 oascc.ZkStateReader$3.process Updating live nodes... (23)
[junit4] 2> 130882 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130887 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130890 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
[junit4] 2> 130909 T408 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130909 T424 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130910 T452 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130910 T428 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130911 T400 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130911 T412 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130911 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130910 T430 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130910 T450 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130910 T436 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130910 T414 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130910 T442 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130910 T406 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130914 T454 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e709107 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130910 T434 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130910 T418 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130910 T422 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130909 T416 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130909 T426 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130909 T444 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130909 T432 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130909 T438 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130914 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130911 T446 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130911 T448 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130911 T420 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130911 T410 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130911 T440 oascc.ZkStateReader$3.process Updating live nodes... (24)
[junit4] 2> 130918 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130921 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
[junit4] 2> 130926 T408 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130926 T426 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130926 T406 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130927 T434 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130927 T420 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130927 T440 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130927 T452 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130927 T400 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130927 T430 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130927 T428 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130927 T422 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130926 T418 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130926 T416 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130926 T432 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130926 T438 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130926 T444 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130926 T424 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130929 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130928 T410 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130928 T414 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130928 T454 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130928 T442 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130928 T446 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130928 T448 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130928 T412 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130927 T436 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130927 T450 oascc.ZkStateReader$3.process Updating live nodes... (25)
[junit4] 2> 130931 T456 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72e0e90a name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130935 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130936 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130939 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
[junit4] 2> 130943 T410 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130944 T412 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130943 T420 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130944 T422 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130945 T424 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130945 T434 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130945 T414 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130946 T452 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130945 T432 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130945 T440 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130945 T444 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130945 T408 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130945 T406 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130944 T430 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130944 T428 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130944 T400 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130944 T456 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130944 T442 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130944 T446 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130944 T448 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130944 T450 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130949 T458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5cd2aec1 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130947 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130946 T418 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130946 T426 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130946 T436 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130946 T416 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130945 T454 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130945 T438 oascc.ZkStateReader$3.process Updating live nodes... (26)
[junit4] 2> 130951 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130954 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130957 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
[junit4] 2> 130961 T408 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T424 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T458 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T420 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130961 T426 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130963 T428 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130961 T444 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130964 T452 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130964 T430 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130964 T422 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130963 T450 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130963 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130963 T446 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130963 T416 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130963 T432 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130963 T438 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130963 T448 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130963 T410 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T440 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T456 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T412 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T442 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T414 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T406 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T400 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T418 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130962 T434 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130966 T460 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e09645c name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130964 T454 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130964 T436 oascc.ZkStateReader$3.process Updating live nodes... (27)
[junit4] 2> 130970 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130972 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130975 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
[junit4] 2> 130980 T416 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130980 T438 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130980 T424 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130981 T442 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130981 T444 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130980 T418 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130982 T440 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130982 T436 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130982 T448 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130983 T400 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130980 T406 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130983 T368 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 130980 T432 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130982 T414 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130982 T422 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130982 T454 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130982 T452 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130982 T446 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130986 T462 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42ff95b0 name:ZooKeeperConnection Watcher:127.0.0.1:41651/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 130982 T458 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130982 T430 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130981 T420 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130981 T412 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130981 T428 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130981 T410 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130981 T450 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130981 T456 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130981 T460 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130981 T408 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130980 T434 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130980 T426 oascc.ZkStateReader$3.process Updating live nodes... (28)
[junit4] 2> 130986 T368 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 130991 T368 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 130994 T368 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
[junit4] 2> 130998 T460 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 130998 T440 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 130998 T412 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 130998 T448 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 131000 T430 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 131000 T422 oascc.ZkStateReader$3.process Updating live nodes... (29)
[junit4] 2> 131000 T434 oascc.ZkState
[...truncated too long message...]
nit4] 2> 152204 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 152208 T368 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:26420_solr
[junit4] 2> 152208 T368 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 152210 T368 oasc.Overseer.start Overseer (id=91331712246415364-127.0.0.1:26420_solr-n_0000000000) starting
[junit4] 2> 152212 T368 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 152215 T368 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 152218 T368 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 152220 T898 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 152220 T898 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 152220 T897 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 152222 T897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 152223 T897 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=12 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"12",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 152223 T897 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9, shard10, shard11, shard12]
[junit4] 2> 152224 T897 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard10
[junit4] 2> 152226 T896 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 152227 T894 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 152227 T888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 152723 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard10/election
[junit4] 2> 152753 T368 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard10
[junit4] 2> 152766 T896 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 152766 T368 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 152767 T897 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 152775 T888 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 152775 T894 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 152778 T368 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:26420 26420
[junit4] 2> 152843 T368 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 152846 T368 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 152846 T368 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 153322 T881 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 153322 T881 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 153323 T881 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard3/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 155847 T368 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=da, timezone=EAT
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=75672752,total=145752064
[junit4] 2> NOTE: All tests run in this JVM: [AlternateDirectoryTest, TestRemoteStreaming, TestSystemIdResolver, TestCloudManagedSchemaAddField, TestJmxMonitoredMap, TestValueSourceCache, CircularListTest, ClusterStateUpdateTest, TestCollationField, QueryElevationComponentTest, SuggestComponentTest, RequestHandlersTest, TestSchemaResource, OverseerTest]
[junit4] Completed on J0 in 28.84s, 8 tests, 1 error <<< FAILURES!
[...truncated 987 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:471: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:451: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:490: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1278: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:911: There were test failures: 363 suites, 1570 tests, 1 error, 36 ignored (8 assumptions)
Total time: 63 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure