You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/05/15 16:03:29 UTC
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1248 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1248/
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:34118/akd returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:34118/akd returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([D0E4C1152C378ED4:51024F0D5B68EEE8]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:56464/j returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:56464/j returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([D0E4C1152C378ED4:51024F0D5B68EEE8]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9590 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.156; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /j/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.160; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.161; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.162; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.263; org.apache.solr.cloud.ZkTestServer; start zk server on port:17616
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.264; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.268; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@494e7ecf name:ZooKeeperConnection Watcher:127.0.0.1:17616 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.268; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.268; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.323; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.376; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2d203eb6 name:ZooKeeperConnection Watcher:127.0.0.1:17616/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.376; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.377; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.424; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.426; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.457; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.460; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.460; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.469; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.470; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.576; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.577; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.587; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.588; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.590; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.591; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.593; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.594; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.601; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.602; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.604; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.605; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.607; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.607; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.760; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.765; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:20738
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.766; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.767; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.767; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368625451615
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.768; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368625451615/solr.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.768; org.apache.solr.core.CoreContainer; New CoreContainer 412088431
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.769; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368625451615/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.769; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368625451615/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.860; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.861; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.861; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.861; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.862; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.862; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.862; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.863; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.863; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.864; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.876; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.877; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:17616/solr
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.877; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.878; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.881; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@20f6adce name:ZooKeeperConnection Watcher:127.0.0.1:17616 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.882; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.884; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.894; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.896; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7401c28a name:ZooKeeperConnection Watcher:127.0.0.1:17616/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.896; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.898; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.908; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.911; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.913; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:20738_j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.922; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:20738_j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.925; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.944; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.947; org.apache.solr.cloud.Overseer; Overseer (id=89694237567614979-127.0.0.1:20738_j-n_0000000000) starting
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.958; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.970; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.970; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.973; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.974; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.977; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.981; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368625451615/collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.982; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.982; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.982; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.983; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368625451615/collection1/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.985; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1368625451615/collection1/lib/README' to classloader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:11.985; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1368625451615/collection1/lib/classes/' to classloader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.022; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.064; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.165; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.170; org.apache.solr.schema.IndexSchema; [collection1] Schema name=test
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.599; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.602; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.604; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.608; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.621; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.621; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368625451615/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368625451161/control/data/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.622; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@199f55f4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.622; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.623; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/control/data
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.623; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368625451161/control/data/index/
[junit4:junit4] 1> WARN - 2013-05-15 13:44:12.623; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368625451161/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.623; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/control/data/index
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.626; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f872253 lockFactory=org.apache.lucene.store.NativeFSLockFactory@29ac7e44),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.626; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.628; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.629; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.629; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.630; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.630; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.630; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.631; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.631; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.631; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.640; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.644; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@4434a330 main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.645; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368625451161/control/data/tlog
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.645; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.646; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.648; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@4434a330 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.649; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 1> INFO - 2013-05-15 13:44:12.649; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.480; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.480; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":null,
[junit4:junit4] 1> "numShards":"1",
[junit4:junit4] 1> "shard":null,
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:20738_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:20738/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.480; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.481; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.494; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.658; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.658; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:20738/j collection:control_collection shard:shard1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.659; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.675; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.678; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.679; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.679; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:20738/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.679; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.680; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:20738/j/collection1/ has no replicas
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.680; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:20738/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:13.680; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:14.998; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.016; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.062; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:20738/j/collection1/ and leader is http://127.0.0.1:20738/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.062; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:20738/j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.062; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.063; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.063; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.065; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.066; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.067; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.068; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.078; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.079; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.081; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@615fcd84 name:ZooKeeperConnection Watcher:127.0.0.1:17616/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.082; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.083; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.085; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.230; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.232; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:56464
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.234; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.234; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.235; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368625455085
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.235; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368625455085/solr.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.235; org.apache.solr.core.CoreContainer; New CoreContainer 489914933
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.236; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368625455085/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.236; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368625455085/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.315; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.316; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.316; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.317; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.317; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.318; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.318; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.318; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.319; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.319; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.331; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.332; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:17616/solr
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.332; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.333; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.336; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7cd7ce75 name:ZooKeeperConnection Watcher:127.0.0.1:17616 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.337; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.345; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.353; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.355; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@15a6b46d name:ZooKeeperConnection Watcher:127.0.0.1:17616/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.356; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:15.367; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.370; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56464_j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.372; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:56464_j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.424; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.424; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.424; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.424; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.430; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368625455085/collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.430; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.431; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.431; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.432; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368625455085/collection1/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.433; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1368625455085/collection1/lib/README' to classloader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.434; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1368625455085/collection1/lib/classes/' to classloader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.469; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.528; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.529; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.530; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:20738_j_collection1",
[junit4:junit4] 1> "numShards":"1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:20738_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:20738/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.549; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.549; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.629; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.629; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:16.634; org.apache.solr.schema.IndexSchema; [collection1] Schema name=test
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.014; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.016; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.018; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.022; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.037; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.038; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368625455085/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.038; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@199f55f4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.038; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.039; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.039; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty1/index/
[junit4:junit4] 1> WARN - 2013-05-15 13:44:17.039; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.040; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty1/index
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.043; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2552f3b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ae0e95f),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.043; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.045; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.045; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.046; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.046; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.047; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.047; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.047; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.048; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.048; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.056; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.061; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@194d3d26 main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.061; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty1/tlog
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.062; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.062; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.065; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@194d3d26 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.067; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 1> INFO - 2013-05-15 13:44:17.067; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.053; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.054; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":null,
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "shard":null,
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:56464_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:56464/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.054; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.055; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.069; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.069; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.069; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.097; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.097; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:56464/j collection:collection1 shard:shard1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.098; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.128; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.130; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.130; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.130; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:56464/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.131; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.131; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:56464/j/collection1/ has no replicas
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.131; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:56464/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:18.131; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.573; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.594; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.594; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.594; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.614; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:56464/j/collection1/ and leader is http://127.0.0.1:56464/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.614; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56464/j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.614; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.614; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.615; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.616; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.617; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.618; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.618; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.780; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.784; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:60808
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.785; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.786; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.786; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368625459628
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.787; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368625459628/solr.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.787; org.apache.solr.core.CoreContainer; New CoreContainer 931771524
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.788; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368625459628/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.789; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368625459628/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.905; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.906; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.906; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.906; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.907; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.907; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.908; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.908; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.908; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.909; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.920; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.921; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:17616/solr
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.921; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.922; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.926; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@56c0de8a name:ZooKeeperConnection Watcher:127.0.0.1:17616 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.927; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.929; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.938; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.943; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@31c737b3 name:ZooKeeperConnection Watcher:127.0.0.1:17616/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.943; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:19.957; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.960; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60808_j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.962; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:60808_j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.965; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.965; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.965; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.965; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.965; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.966; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.977; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.986; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368625459628/collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.986; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.987; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.987; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.989; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368625459628/collection1/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.990; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1368625459628/collection1/lib/classes/' to classloader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:20.991; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1368625459628/collection1/lib/README' to classloader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.054; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.099; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.100; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:56464_j_collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:56464_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:56464/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.113; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.113; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.113; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.113; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.132; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.233; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.241; org.apache.solr.schema.IndexSchema; [collection1] Schema name=test
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.975; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.979; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.982; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:21.987; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.005; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.006; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368625459628/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty2/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.006; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@199f55f4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.007; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.008; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.008; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty2/index/
[junit4:junit4] 1> WARN - 2013-05-15 13:44:22.009; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.009; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty2/index
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.012; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b9828d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bfcae57),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.013; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.016; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.016; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.017; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.018; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.018; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.019; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.019; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.020; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.021; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.041; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.051; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@21e6d278 main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.051; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty2/tlog
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.052; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.053; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.073; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@21e6d278 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.075; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.075; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.616; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.617; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":null,
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "shard":null,
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:60808_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:60808/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.618; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.618; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.632; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.632; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.632; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:22.632; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.078; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.078; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:60808/j collection:collection1 shard:shard2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.079; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.094; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.097; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.097; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.097; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:60808/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.097; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.098; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:60808/j/collection1/ has no replicas
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.098; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:60808/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:23.098; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.135; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.173; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.173; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.173; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.173; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.225; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:60808/j/collection1/ and leader is http://127.0.0.1:60808/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.225; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60808/j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.225; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.226; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.226; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.232; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.233; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.234; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.234; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.474; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.478; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:38168
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.479; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.479; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.480; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368625464244
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.480; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368625464244/solr.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.481; org.apache.solr.core.CoreContainer; New CoreContainer 1814791328
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.482; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368625464244/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.482; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368625464244/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.611; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.612; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.613; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.614; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.614; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.615; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.616; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.616; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.617; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.618; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.637; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.638; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:17616/solr
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.639; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.640; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.643; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7181aa11 name:ZooKeeperConnection Watcher:127.0.0.1:17616 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.644; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.658; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.673; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.677; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6bf4becc name:ZooKeeperConnection Watcher:127.0.0.1:17616/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.678; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:24.695; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.694; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.695; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:60808_j_collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:60808_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:60808/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.708; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.708; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.708; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38168_j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.708; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.708; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.708; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.716; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:38168_j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.718; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.718; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.719; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.719; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.719; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.719; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.719; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.720; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.719; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.721; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.725; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368625464244/collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.726; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.726; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.726; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.727; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368625464244/collection1/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.728; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1368625464244/collection1/lib/README' to classloader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.729; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1368625464244/collection1/lib/classes/' to classloader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.764; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.806; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.907; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:25.912; org.apache.solr.schema.IndexSchema; [collection1] Schema name=test
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.438; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.443; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.445; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.451; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.474; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.475; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368625464244/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.476; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@199f55f4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.477; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.478; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.478; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3/index/
[junit4:junit4] 1> WARN - 2013-05-15 13:44:26.478; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.480; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3/index
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.484; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13facef4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@722a2399),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.484; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.489; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.489; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.490; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.491; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.492; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.492; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.493; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.494; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.495; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.515; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.525; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7ffd5eae main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.525; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3/tlog
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.527; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.527; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.533; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@7ffd5eae main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.537; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 1> INFO - 2013-05-15 13:44:26.538; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.218; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.219; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":null,
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "shard":null,
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:38168_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:38168/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.219; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.219; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.260; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.544; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.544; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:38168/j collection:collection1 shard:shard1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.547; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:38168/j/collection1/ and leader is http://127.0.0.1:56464/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.547; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38168/j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.547; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.548; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.548; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.548; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.548; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.549; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.549; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.549; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.550; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.550; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.550; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.564; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:38168_j_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.715; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.718; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:16834
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.719; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.719; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.719; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368625467562
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.720; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368625467562/solr.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.720; org.apache.solr.core.CoreContainer; New CoreContainer 1551968805
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.721; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368625467562/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.721; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368625467562/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.802; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.802; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.803; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.803; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.803; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.804; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.804; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.804; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.805; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.805; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.817; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.817; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:17616/solr
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.818; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.818; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.822; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6cf1bb97 name:ZooKeeperConnection Watcher:127.0.0.1:17616 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.822; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.841; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.850; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.853; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@66aacee4 name:ZooKeeperConnection Watcher:127.0.0.1:17616/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.853; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 1> INFO - 2013-05-15 13:44:27.867; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.764; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.764; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:38168_j_collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"recovering",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:38168_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:38168/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.782; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.782; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.782; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.783; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.782; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.782; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.869; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:16834_j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.871; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:16834_j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.873; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.873; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.873; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.873; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.873; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.873; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.873; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.874; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.874; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.874; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.882; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.882; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.887; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368625467562/collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.887; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.887; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.888; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.888; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368625467562/collection1/'
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.889; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1368625467562/collection1/lib/README' to classloader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.890; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1368625467562/collection1/lib/classes/' to classloader
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.925; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 1> INFO - 2013-05-15 13:44:28.967; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.068; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.075; org.apache.solr.schema.IndexSchema; [collection1] Schema name=test
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.566; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:38168_j_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.566; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:38168_j_collection1&state=recovering&nodeName=127.0.0.1:38168_j&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.624; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.627; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.629; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.632; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.646; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.647; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368625467562/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.647; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@199f55f4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.647; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.648; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.648; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4/index/
[junit4:junit4] 1> WARN - 2013-05-15 13:44:29.648; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.650; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4/index
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.652; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@142b7506 lockFactory=org.apache.lucene.store.NativeFSLockFactory@41fdc338),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.652; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.654; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.655; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.655; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.656; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.656; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.656; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.657; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.657; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.657; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.666; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.670; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7c0d3bdb main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.670; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4/tlog
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.671; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.671; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.674; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@7c0d3bdb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.676; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 1> INFO - 2013-05-15 13:44:29.676; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.287; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.288; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":null,
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "shard":null,
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"down",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:16834_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:16834/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.288; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.288; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.302; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.302; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.302; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.302; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.302; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.302; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.679; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.679; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:16834/j collection:collection1 shard:shard2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.682; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:16834/j/collection1/ and leader is http://127.0.0.1:60808/j/collection1/
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.683; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:16834/j
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.683; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.683; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.684; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.684; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.685; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.685; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.685; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.686; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.686; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.687; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.687; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.701; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.702; org.apache.solr.cloud.AbstractFullDistribZkTestBase; Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.702; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.702; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:16834_j_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 1> INFO - 2013-05-15 13:44:30.703; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.568; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:56464/j/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.568; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:38168/j START replicas=[http://127.0.0.1:56464/j/collection1/] nUpdates=100
[junit4:junit4] 1> WARN - 2013-05-15 13:44:31.569; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.570; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.570; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.570; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.570; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.570; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:56464/j/collection1/. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.570; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.579; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.579; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.582; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2552f3b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ae0e95f),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.583; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.583; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2552f3b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ae0e95f),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2552f3b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ae0e95f),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.584; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.584; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@6cf68270 realtime
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.585; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.585; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.586; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.586; org.apache.solr.handler.SnapPuller; No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.588; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.589; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.589; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.590; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.590; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.592; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.593; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.594; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3/index.20130515214431593
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.594; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@cb572b lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b446c9c) fullCopy=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.597; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.598; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.599; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.599; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.601; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13facef4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@722a2399),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13facef4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@722a2399),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.601; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.601; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.602; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7cf84595 main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.603; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@7cf84595 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.603; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3/index.20130515214431593 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3/index.20130515214431593;done=true>>]
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.603; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3/index.20130515214431593
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.604; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty3/index.20130515214431593
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.604; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.604; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.604; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.604; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.889; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.890; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.891; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.892; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:16834_j_collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"recovering",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:16834_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:16834/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.905; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:38168_j_collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:38168_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:38168/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.916; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.916; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.916; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.916; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.916; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:31.916; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:32.705; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:16834_j_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:32.705; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:16834_j_collection1&state=recovering&nodeName=127.0.0.1:16834_j&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 1> INFO - 2013-05-15 13:44:32.891; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:33.893; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.707; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:60808/j/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.707; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:16834/j START replicas=[http://127.0.0.1:60808/j/collection1/] nUpdates=100
[junit4:junit4] 1> WARN - 2013-05-15 13:44:34.708; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.708; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.708; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.708; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.708; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.708; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:60808/j/collection1/. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.708; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.715; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.717; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.719; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b9828d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bfcae57),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.720; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.721; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b9828d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bfcae57),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b9828d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bfcae57),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.721; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.721; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@c71df7f realtime
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.722; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.722; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.723; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.723; org.apache.solr.handler.SnapPuller; No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.725; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.725; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.726; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.726; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.726; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.728; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.729; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.730; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4/index.20130515214434729
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.730; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@21de5f8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47bc054c) fullCopy=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.733; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.734; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.735; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.735; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.737; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@142b7506 lockFactory=org.apache.lucene.store.NativeFSLockFactory@41fdc338),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@142b7506 lockFactory=org.apache.lucene.store.NativeFSLockFactory@41fdc338),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.737; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.737; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.738; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1b846968 main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.739; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1b846968 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.739; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4/index.20130515214434729 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4/index.20130515214434729;done=true>>]
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.739; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4/index.20130515214434729
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.739; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368625451161/jetty4/index.20130515214434729
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.740; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.740; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.740; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.740; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.748; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.895; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.925; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.926; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 1> "operation":"state",
[junit4:junit4] 1> "core_node_name":"127.0.0.1:16834_j_collection1",
[junit4:junit4] 1> "numShards":"2",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "roles":null,
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "shard_state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard_range":null,
[junit4:junit4] 1> "node_name":"127.0.0.1:16834_j",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:16834/j"}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.998; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.998; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.998; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.998; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.998; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:34.998; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.897; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.898; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: collection1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.905; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.907; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f872253 lockFactory=org.apache.lucene.store.NativeFSLockFactory@29ac7e44),segFN=segments_1,generation=1}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.908; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.908; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f872253 lockFactory=org.apache.lucene.store.NativeFSLockFactory@29ac7e44),segFN=segments_1,generation=1}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f872253 lockFactory=org.apache.lucene.store.NativeFSLockFactory@29ac7e44),segFN=segments_2,generation=2}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.909; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.909; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@29e49019 main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.909; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.910; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@29e49019 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.910; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.918; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.921; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2552f3b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ae0e95f),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2552f3b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ae0e95f),segFN=segments_3,generation=3}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.921; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.921; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@377675bd main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.922; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.922; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@377675bd main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.923; org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode: http://127.0.0.1:38168/j/collection1/, StdNode: http://127.0.0.1:60808/j/collection1/, StdNode: http://127.0.0.1:16834/j/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.926; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.927; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b9828d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bfcae57),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b9828d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bfcae57),segFN=segments_3,generation=3}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.927; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.928; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@373d0302 main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.928; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.929; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@373d0302 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.929; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.931; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.932; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13facef4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@722a2399),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13facef4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@722a2399),segFN=segments_3,generation=3}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.933; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.933; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.934; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@142b7506 lockFactory=org.apache.lucene.store.NativeFSLockFactory@41fdc338),segFN=segments_2,generation=2}
[junit4:junit4] 1> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@142b7506 lockFactory=org.apache.lucene.store.NativeFSLockFactory@41fdc338),segFN=segments_3,generation=3}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.934; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3f5e14ad main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.934; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.934; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.935; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3bc8c2cf main
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.935; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@3f5e14ad main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.935; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.936; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@3bc8c2cf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.936; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.936; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.937; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 19
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.938; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.941; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.942; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.944; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:35.945; org.apache.solr.core.SolrCore; [collection1] webapp=/j path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.951; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435107829166899200)} 0 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.962; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={update.distrib=FROMLEADER&_version_=-1435107829171093504&update.from=http://127.0.0.1:60808/j/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435107829171093504)} 0 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.966; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={update.distrib=FROMLEADER&_version_=-1435107829177384960&update.from=http://127.0.0.1:56464/j/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435107829177384960)} 0 2
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.967; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435107829177384960)} 0 7
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.968; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435107829171093504)} 0 15
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.972; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[a!0 (1435107829189967872)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.983; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435107829197307904)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.984; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1435107829197307904)]} 0 6
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.984; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[a!0]} 0 9
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.988; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[b!1 (1435107829205696512)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.996; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435107829210939392)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:37.997; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[b!1 (1435107829210939392)]} 0 6
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.001; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[c!2 (1435107829219328000)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.010; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435107829226668032)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.011; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1435107829226668032)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.012; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[c!2]} 0 8
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.015; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[d!3 (1435107829235056640)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.024; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435107829241348096)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.025; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!3 (1435107829241348096)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.026; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[d!3]} 0 7
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.030; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[e!4 (1435107829249736704)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.036; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435107829253931008)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.037; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[e!4 (1435107829253931008)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.040; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[f!5 (1435107829261271040)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.046; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435107829264416768)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.047; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[f!5 (1435107829264416768)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.051; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[g!6 (1435107829271756800)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.057; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435107829274902528)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.058; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[g!6 (1435107829274902528)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.062; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[h!7 (1435107829283291136)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.068; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435107829286436864)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.069; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[h!7 (1435107829286436864)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.073; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[i!8 (1435107829295874048)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.083; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435107829302165504)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.084; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!8 (1435107829302165504)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.084; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[i!8]} 0 8
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.088; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[j!9 (1435107829311602688)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.095; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435107829315796992)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.096; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[j!9 (1435107829315796992)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.100; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[k!10 (1435107829323137024)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.110; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435107829330477056)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.111; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1435107829330477056)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.111; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[k!10]} 0 8
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.115; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[l!11 (1435107829338865664)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.121; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435107829342011392)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.121; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[l!11 (1435107829342011392)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.124; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[m!12 (1435107829349351424)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.131; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435107829352497152)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.132; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[m!12 (1435107829352497152)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.135; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[n!13 (1435107829360885760)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.142; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435107829364031488)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.142; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[n!13 (1435107829364031488)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.146; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[o!14 (1435107829372420096)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.152; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435107829375565824)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.153; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[o!14 (1435107829375565824)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.156; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[p!15 (1435107829382905856)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.163; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435107829386051584)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.164; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[p!15 (1435107829386051584)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.167; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[q!16 (1435107829393391616)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.175; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435107829399683072)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.176; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1435107829399683072)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.177; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[q!16]} 0 8
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.181; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[r!17 (1435107829408071680)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.190; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435107829415411712)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.191; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!17 (1435107829415411712)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.191; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[r!17]} 0 8
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.195; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[s!18 (1435107829422751744)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.202; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435107829426946048)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.202; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[s!18 (1435107829426946048)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.206; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[t!19 (1435107829434286080)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.211; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435107829437431808)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.212; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[t!19 (1435107829437431808)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.215; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[u!20 (1435107829444771840)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.224; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435107829450014720)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.224; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1435107829450014720)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.225; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[u!20]} 0 7
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.229; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[v!21 (1435107829458403328)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.238; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435107829464694784)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.238; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!21 (1435107829464694784)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.239; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[v!21]} 0 8
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.243; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[w!22 (1435107829473083392)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.248; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435107829476229120)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.249; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[w!22 (1435107829476229120)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.252; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[x!23 (1435107829483569152)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.257; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435107829486714880)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.258; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[x!23 (1435107829486714880)]} 0 3
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.261; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[y!24 (1435107829491957760)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.267; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435107829495103488)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.267; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[y!24 (1435107829495103488)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.270; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[z!25 (1435107829502443520)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.279; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435107829507686400)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.279; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1435107829507686400)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.280; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[z!25]} 0 7
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.283; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[a!26 (1435107829516075008)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.291; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435107829521317888)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.292; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!26 (1435107829521317888)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.293; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[a!26]} 0 7
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.297; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[b!27 (1435107829529706496)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.302; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435107829533900800)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.303; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1435107829533900800)]} 0 3
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.304; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[b!27]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.306; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[c!28 (1435107829540192256)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.313; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435107829543337984)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.314; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[c!28 (1435107829543337984)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.316; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[d!29 (1435107829550678016)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.322; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435107829553823744)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.323; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[d!29 (1435107829553823744)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.326; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[e!30 (1435107829561163776)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.332; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435107829564309504)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.333; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[e!30 (1435107829564309504)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.337; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[f!31 (1435107829571649536)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.343; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435107829574795264)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.343; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[f!31 (1435107829574795264)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.347; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[g!32 (1435107829582135296)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.354; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435107829587378176)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.355; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!32 (1435107829587378176)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.355; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[g!32]} 0 6
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.358; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[h!33 (1435107829594718208)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.365; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435107829597863936)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.366; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[h!33 (1435107829597863936)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.369; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[i!34 (1435107829605203968)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.378; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435107829611495424)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.378; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:60808/j/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1435107829611495424)]} 0 4
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.379; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[i!34]} 0 8
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.383; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[j!35 (1435107829619884032)]} 0 0
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.389; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={distrib.from=http://127.0.0.1:56464/j/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435107829623029760)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.390; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[j!35 (1435107829623029760)]} 0 5
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.394; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/j path=/update params={wt=javabin&version=2} {add=[k!36 (1435107829631418368)]} 0 1
[junit4:junit4] 1> INFO - 2013-05-15 13:44:38.400; org.apache.solr.u
[...truncated too long message...]
1738ead8
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.843; org.apache.solr.update.DirectUpdateHandler2; closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=831,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.843; org.apache.solr.update.SolrCoreState; Closing SolrCoreState
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.843; org.apache.solr.update.DefaultSolrCoreState; SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.843; org.apache.solr.update.DefaultSolrCoreState; closing IndexWriter with IndexWriterCloser
[junit4:junit4] 1> ERROR - 2013-05-15 13:47:43.844; org.apache.solr.update.TransactionLog; Error: Forcing close of tlog{file=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368625353915/jetty4/tlog/tlog.0000000000000000003 refcount=1}
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.847; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.847; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.847; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368625353915/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368625353915/jetty4;done=false>>]
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.847; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368625353915/jetty4
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.848; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368625353915/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368625353915/jetty4/index;done=false>>]
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.848; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368625353915/jetty4/index
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.848; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 1> WARN - 2013-05-15 13:47:43.848; org.apache.solr.cloud.LeaderElector$1;
[junit4:junit4] 1> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89694231196270604-127.0.0.1:18031_akd_collection1-n_0000000001
[junit4:junit4] 1> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 1> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 1> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 1> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 1> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 1> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 1> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 1> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 1> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:246)
[junit4:junit4] 1> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 1> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 1> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 1> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 1> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 1> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 1> WARN - 2013-05-15 13:47:43.849; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.849; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> WARN - 2013-05-15 13:47:43.849; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 1> INFO - 2013-05-15 13:47:43.849; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 1> WARN - 2013-05-15 13:47:43.850; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 1> WARN - 2013-05-15 13:47:43.850; org.apache.solr.cloud.LeaderElector$1;
[junit4:junit4] 1> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 1> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 1> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 1> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 1> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 1> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 1> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 1> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 1> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 1> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 1> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 1> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 1> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=en_GB, timezone=America/Argentina/Cordoba
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=3,free=125240744,total=536870912
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestBadConfig, QueryParsingTest, PluginInfoTest, UpdateRequestProcessorFactoryTest, CoreAdminHandlerTest, TestAnalyzedSuggestions, QueryEqualityTest, TestDefaultSearchFieldResource, RequiredFieldsTest, TestTrie, PeerSyncTest, TestIBSimilarityFactory, TestRemoteStreaming, FastVectorHighlighterTest, CacheHeaderTest, IndexSchemaRuntimeFieldTest, TestOmitPositions, PolyFieldTest, SolrIndexSplitterTest, TestSchemaVersionResource, AliasIntegrationTest, TestPostingsSolrHighlighter, TestManagedSchema, TestQuerySenderListener, TestCodecSupport, AutoCommitTest, SuggesterWFSTTest, CollectionsAPIDistributedZkTest, SolrCoreTest, SuggesterTest, QueryElevationComponentTest, LukeRequestHandlerTest, NotRequiredUniqueKeyTest, BadIndexSchemaTest, TestUpdate, TestCharFilters, SliceStateTest, TestCoreContainer, TestSerializedLuceneMatchVersion, BasicDistributedZkTest, TestStressReorder, AlternateDirectoryTest, TestHashPartitioner, FullSolrCloudDistribCmdsTest, FieldAnalysisRequestHandlerTest, TestSurroundQueryParser, SolrCmdDistributorTest, TestPropInjectDefaults, TestDefaultSimilarityFactory, LeaderElectionTest, TestCSVLoader, UpdateParamsTest, SystemInfoHandlerTest, TestSolrIndexConfig, TestPropInject, TestWordDelimiterFilterFactory, TestFieldCollectionResource, TestSolrQueryParserDefaultOperatorResource, SortByFunctionTest, SpellingQueryConverterTest, TestFiltering, IndexReaderFactoryTest, TestMaxScoreQueryParser, AnalysisAfterCoreReloadTest, DistanceFunctionTest, SynonymTokenizerTest, MBeansHandlerTest, BadCopyFieldTest, TestSolrCoreProperties, SearchHandlerTest, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J1 in 310.42s, 1 test, 1 error <<< FAILURES!
[...truncated 473 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 2 errors, 28 ignored (9 assumptions)
Total time: 53 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1257 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1257/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:43852 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:43852 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([DD2405EC2AAE3678:5CC28BF45DF15644]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9611 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 1120749 T2506 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 1120755 T2506 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1368791788481
[junit4:junit4] 2> 1120756 T2506 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1120756 T2507 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1120857 T2506 oasc.ZkTestServer.run start zk server on port:43845
[junit4:junit4] 2> 1120858 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1120861 T2513 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@206de4d name:ZooKeeperConnection Watcher:127.0.0.1:43845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1120861 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1120862 T2506 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1120875 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1120877 T2515 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50bb5dcc name:ZooKeeperConnection Watcher:127.0.0.1:43845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1120877 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1120878 T2506 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1120887 T2506 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1120890 T2506 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1120897 T2506 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1120900 T2506 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1120901 T2506 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1120911 T2506 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1120912 T2506 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1121037 T2506 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1121037 T2506 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1121048 T2506 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1121049 T2506 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1121051 T2506 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1121052 T2506 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1121054 T2506 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1121055 T2506 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1121062 T2506 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1121063 T2506 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1121065 T2506 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1121066 T2506 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1121068 T2506 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1121068 T2506 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1121218 T2506 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1121222 T2506 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43848
[junit4:junit4] 2> 1121222 T2506 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1121223 T2506 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1121223 T2506 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368791788803
[junit4:junit4] 2> 1121224 T2506 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368791788803/solr.xml
[junit4:junit4] 2> 1121224 T2506 oasc.CoreContainer.<init> New CoreContainer 327294975
[junit4:junit4] 2> 1121224 T2506 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368791788803/'
[junit4:junit4] 2> 1121225 T2506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368791788803/'
[junit4:junit4] 2> 1121303 T2506 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1121304 T2506 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1121304 T2506 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1121305 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1121305 T2506 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1121306 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1121306 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1121306 T2506 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1121307 T2506 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1121307 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1121318 T2506 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1121318 T2506 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43845/solr
[junit4:junit4] 2> 1121319 T2506 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1121320 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1121322 T2526 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23f8cc50 name:ZooKeeperConnection Watcher:127.0.0.1:43845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1121324 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1121325 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1121334 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1121336 T2528 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b4675c name:ZooKeeperConnection Watcher:127.0.0.1:43845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1121336 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1121338 T2506 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1121347 T2506 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1121350 T2506 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1121356 T2506 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43848_
[junit4:junit4] 2> 1121358 T2506 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43848_
[junit4:junit4] 2> 1121364 T2506 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1121375 T2506 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1121384 T2506 oasc.Overseer.start Overseer (id=89705138650284035-127.0.0.1:43848_-n_0000000000) starting
[junit4:junit4] 2> 1121394 T2506 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1121406 T2530 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1121406 T2506 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1121408 T2506 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1121409 T2506 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1121411 T2529 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1121414 T2531 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368791788803/collection1
[junit4:junit4] 2> 1121414 T2531 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1121415 T2531 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1121415 T2531 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1121416 T2531 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368791788803/collection1/'
[junit4:junit4] 2> 1121418 T2531 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1368791788803/collection1/lib/README' to classloader
[junit4:junit4] 2> 1121418 T2531 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1368791788803/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1121471 T2531 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1121533 T2531 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1121634 T2531 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1121640 T2531 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1122234 T2531 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1122239 T2531 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1122241 T2531 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1122246 T2531 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1122267 T2531 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1122267 T2531 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368791788803/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368791788481/control/data/
[junit4:junit4] 2> 1122268 T2531 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@171917ca
[junit4:junit4] 2> 1122268 T2531 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1122269 T2531 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/control/data
[junit4:junit4] 2> 1122270 T2531 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368791788481/control/data/index/
[junit4:junit4] 2> 1122270 T2531 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368791788481/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1122270 T2531 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/control/data/index
[junit4:junit4] 2> 1122274 T2531 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76a08c0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1adbc15),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1122274 T2531 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1122277 T2531 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1122278 T2531 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1122279 T2531 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1122279 T2531 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1122280 T2531 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1122280 T2531 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1122280 T2531 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1122281 T2531 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1122281 T2531 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1122294 T2531 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1122300 T2531 oass.SolrIndexSearcher.<init> Opening Searcher@42a4fd6d main
[junit4:junit4] 2> 1122301 T2531 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368791788481/control/data/tlog
[junit4:junit4] 2> 1122302 T2531 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1122302 T2531 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1122305 T2532 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@42a4fd6d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1122307 T2531 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1122308 T2531 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1122914 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1122915 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43848_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43848"}
[junit4:junit4] 2> 1122915 T2529 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1122915 T2529 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1122931 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1123310 T2531 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1123310 T2531 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43848 collection:control_collection shard:shard1
[junit4:junit4] 2> 1123311 T2531 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1123429 T2531 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1123478 T2531 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1123479 T2531 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1123479 T2531 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43848/collection1/
[junit4:junit4] 2> 1123479 T2531 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1123480 T2531 oasc.SyncStrategy.syncToMe http://127.0.0.1:43848/collection1/ has no replicas
[junit4:junit4] 2> 1123480 T2531 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43848/collection1/
[junit4:junit4] 2> 1123480 T2531 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1124434 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1124472 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1124518 T2531 oasc.ZkController.register We are http://127.0.0.1:43848/collection1/ and leader is http://127.0.0.1:43848/collection1/
[junit4:junit4] 2> 1124518 T2531 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43848
[junit4:junit4] 2> 1124518 T2531 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1124519 T2531 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1124519 T2531 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1124521 T2531 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1124522 T2506 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1124523 T2506 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1124523 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1124538 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1124540 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1124542 T2535 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76065902 name:ZooKeeperConnection Watcher:127.0.0.1:43845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1124542 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1124543 T2506 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1124545 T2506 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1124759 T2506 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1124762 T2506 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43852
[junit4:junit4] 2> 1124763 T2506 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1124763 T2506 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1124764 T2506 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368791792272
[junit4:junit4] 2> 1124765 T2506 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368791792272/solr.xml
[junit4:junit4] 2> 1124765 T2506 oasc.CoreContainer.<init> New CoreContainer 369801783
[junit4:junit4] 2> 1124766 T2506 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368791792272/'
[junit4:junit4] 2> 1124766 T2506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368791792272/'
[junit4:junit4] 2> 1124882 T2506 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1124883 T2506 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1124884 T2506 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1124884 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1124885 T2506 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1124885 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1124886 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1124886 T2506 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1124887 T2506 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1124888 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1124902 T2506 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1124903 T2506 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43845/solr
[junit4:junit4] 2> 1124904 T2506 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1124905 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1124908 T2546 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bfbb325 name:ZooKeeperConnection Watcher:127.0.0.1:43845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1124908 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1124923 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1124934 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1124936 T2548 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d44ed77 name:ZooKeeperConnection Watcher:127.0.0.1:43845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1124936 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1124945 T2506 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1125948 T2506 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43852_
[junit4:junit4] 2> 1125950 T2506 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43852_
[junit4:junit4] 2> 1125953 T2548 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1125953 T2535 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1125953 T2528 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1125954 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1125970 T2549 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368791792272/collection1
[junit4:junit4] 2> 1125970 T2549 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1125971 T2549 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1125971 T2549 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1125972 T2549 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368791792272/collection1/'
[junit4:junit4] 2> 1125974 T2549 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1368791792272/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1125974 T2549 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1368791792272/collection1/lib/README' to classloader
[junit4:junit4] 2> 1125985 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1125986 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43848_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43848"}
[junit4:junit4] 2> 1126000 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1126000 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1126000 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1126031 T2549 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1126092 T2549 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1126193 T2549 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1126199 T2549 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1126797 T2549 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1126801 T2549 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1126804 T2549 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1126809 T2549 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1126830 T2549 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1126831 T2549 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368791792272/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty1/
[junit4:junit4] 2> 1126831 T2549 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@171917ca
[junit4:junit4] 2> 1126832 T2549 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1126832 T2549 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty1
[junit4:junit4] 2> 1126833 T2549 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty1/index/
[junit4:junit4] 2> 1126833 T2549 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1126834 T2549 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty1/index
[junit4:junit4] 2> 1126837 T2549 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2766a7aa lockFactory=org.apache.lucene.store.NativeFSLockFactory@16f5ded2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1126837 T2549 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1126840 T2549 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1126841 T2549 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1126842 T2549 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1126842 T2549 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1126843 T2549 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1126843 T2549 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1126844 T2549 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1126844 T2549 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1126845 T2549 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1126860 T2549 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1126867 T2549 oass.SolrIndexSearcher.<init> Opening Searcher@66cb4b7 main
[junit4:junit4] 2> 1126868 T2549 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty1/tlog
[junit4:junit4] 2> 1126869 T2549 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1126869 T2549 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1126873 T2550 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@66cb4b7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1126876 T2549 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1126876 T2549 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1127504 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1127505 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43852_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43852"}
[junit4:junit4] 2> 1127505 T2529 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1127506 T2529 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1127518 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1127518 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1127518 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1127878 T2549 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1127878 T2549 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43852 collection:collection1 shard:shard1
[junit4:junit4] 2> 1127879 T2549 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1127895 T2549 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1127904 T2549 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1127904 T2549 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1127904 T2549 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43852/collection1/
[junit4:junit4] 2> 1127905 T2549 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1127905 T2549 oasc.SyncStrategy.syncToMe http://127.0.0.1:43852/collection1/ has no replicas
[junit4:junit4] 2> 1127905 T2549 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43852/collection1/
[junit4:junit4] 2> 1127906 T2549 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1129022 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1129075 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1129075 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1129075 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1129083 T2549 oasc.ZkController.register We are http://127.0.0.1:43852/collection1/ and leader is http://127.0.0.1:43852/collection1/
[junit4:junit4] 2> 1129083 T2549 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43852
[junit4:junit4] 2> 1129083 T2549 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1129083 T2549 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1129084 T2549 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1129087 T2549 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1129088 T2506 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1129089 T2506 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1129090 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1129325 T2506 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1129329 T2506 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43859
[junit4:junit4] 2> 1129330 T2506 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1129330 T2506 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1129331 T2506 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368791796832
[junit4:junit4] 2> 1129332 T2506 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368791796832/solr.xml
[junit4:junit4] 2> 1129332 T2506 oasc.CoreContainer.<init> New CoreContainer 76442777
[junit4:junit4] 2> 1129333 T2506 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368791796832/'
[junit4:junit4] 2> 1129333 T2506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368791796832/'
[junit4:junit4] 2> 1129450 T2506 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1129451 T2506 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1129451 T2506 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1129452 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1129452 T2506 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1129453 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1129454 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1129454 T2506 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1129455 T2506 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1129455 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1129471 T2506 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1129472 T2506 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43845/solr
[junit4:junit4] 2> 1129473 T2506 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1129474 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1129477 T2562 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d547a9a name:ZooKeeperConnection Watcher:127.0.0.1:43845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1129478 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1129493 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1129505 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1129507 T2564 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2db56601 name:ZooKeeperConnection Watcher:127.0.0.1:43845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1129508 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1129519 T2506 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1130522 T2506 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43859_
[junit4:junit4] 2> 1130525 T2506 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43859_
[junit4:junit4] 2> 1130527 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1130528 T2528 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1130529 T2564 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1130529 T2548 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1130529 T2535 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1130529 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1130529 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1130546 T2565 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368791796832/collection1
[junit4:junit4] 2> 1130547 T2565 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1130547 T2565 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1130548 T2565 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1130549 T2565 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368791796832/collection1/'
[junit4:junit4] 2> 1130550 T2565 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1368791796832/collection1/lib/README' to classloader
[junit4:junit4] 2> 1130551 T2565 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1368791796832/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1130589 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1130590 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43852_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43852"}
[junit4:junit4] 2> 1130603 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1130603 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1130603 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1130603 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1130606 T2565 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1130667 T2565 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1130768 T2565 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1130774 T2565 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1131367 T2565 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1131371 T2565 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1131374 T2565 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1131379 T2565 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1131399 T2565 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1131399 T2565 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368791796832/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty2/
[junit4:junit4] 2> 1131400 T2565 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@171917ca
[junit4:junit4] 2> 1131400 T2565 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1131402 T2565 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty2
[junit4:junit4] 2> 1131402 T2565 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty2/index/
[junit4:junit4] 2> 1131403 T2565 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1131403 T2565 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty2/index
[junit4:junit4] 2> 1131406 T2565 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69d97a9b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c811134),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1131407 T2565 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1131410 T2565 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1131410 T2565 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1131411 T2565 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1131412 T2565 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1131412 T2565 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1131413 T2565 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1131413 T2565 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1131414 T2565 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1131414 T2565 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1131427 T2565 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1131433 T2565 oass.SolrIndexSearcher.<init> Opening Searcher@205faf6d main
[junit4:junit4] 2> 1131434 T2565 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty2/tlog
[junit4:junit4] 2> 1131435 T2565 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1131435 T2565 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1131440 T2566 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@205faf6d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1131442 T2565 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1131442 T2565 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1132107 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1132108 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43859_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43859"}
[junit4:junit4] 2> 1132108 T2529 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1132108 T2529 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1132146 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1132146 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1132146 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1132146 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1132445 T2565 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1132445 T2565 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43859 collection:collection1 shard:shard2
[junit4:junit4] 2> 1132446 T2565 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1132461 T2565 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1132463 T2565 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1132463 T2565 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1132464 T2565 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43859/collection1/
[junit4:junit4] 2> 1132464 T2565 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1132464 T2565 oasc.SyncStrategy.syncToMe http://127.0.0.1:43859/collection1/ has no replicas
[junit4:junit4] 2> 1132465 T2565 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43859/collection1/
[junit4:junit4] 2> 1132465 T2565 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1133650 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1133723 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1133723 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1133723 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1133723 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1133795 T2565 oasc.ZkController.register We are http://127.0.0.1:43859/collection1/ and leader is http://127.0.0.1:43859/collection1/
[junit4:junit4] 2> 1133795 T2565 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43859
[junit4:junit4] 2> 1133795 T2565 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1133796 T2565 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1133796 T2565 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1133798 T2565 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1133799 T2506 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1133800 T2506 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1133801 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1134044 T2506 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1134048 T2506 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:46477
[junit4:junit4] 2> 1134049 T2506 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1134050 T2506 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1134050 T2506 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368791801545
[junit4:junit4] 2> 1134051 T2506 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368791801545/solr.xml
[junit4:junit4] 2> 1134051 T2506 oasc.CoreContainer.<init> New CoreContainer 1883204769
[junit4:junit4] 2> 1134052 T2506 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368791801545/'
[junit4:junit4] 2> 1134053 T2506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368791801545/'
[junit4:junit4] 2> 1134188 T2506 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1134189 T2506 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1134189 T2506 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1134190 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1134190 T2506 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1134191 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1134191 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1134192 T2506 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1134192 T2506 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1134193 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1134211 T2506 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1134212 T2506 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43845/solr
[junit4:junit4] 2> 1134212 T2506 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1134213 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1134217 T2578 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fc106f1 name:ZooKeeperConnection Watcher:127.0.0.1:43845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1134218 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1134220 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1134241 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1134243 T2580 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@367be3b5 name:ZooKeeperConnection Watcher:127.0.0.1:43845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1134243 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1134247 T2506 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1135251 T2506 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46477_
[junit4:junit4] 2> 1135272 T2506 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46477_
[junit4:junit4] 2> 1135274 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1135274 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1135275 T2580 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1135275 T2548 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1135275 T2528 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1135276 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1135276 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1135277 T2535 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1135277 T2564 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1135283 T2581 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368791801545/collection1
[junit4:junit4] 2> 1135283 T2581 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1135284 T2581 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1135284 T2581 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1135285 T2581 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368791801545/collection1/'
[junit4:junit4] 2> 1135287 T2581 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1368791801545/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1135287 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1135287 T2581 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1368791801545/collection1/lib/README' to classloader
[junit4:junit4] 2> 1135288 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43859_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43859"}
[junit4:junit4] 2> 1135292 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1135292 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1135292 T2580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1135292 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1135292 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1135342 T2581 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1135403 T2581 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1135504 T2581 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1135510 T2581 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1136109 T2581 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1136113 T2581 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1136116 T2581 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1136121 T2581 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1136142 T2581 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1136142 T2581 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368791801545/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/
[junit4:junit4] 2> 1136143 T2581 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@171917ca
[junit4:junit4] 2> 1136143 T2581 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1136144 T2581 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3
[junit4:junit4] 2> 1136145 T2581 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index/
[junit4:junit4] 2> 1136145 T2581 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1136145 T2581 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index
[junit4:junit4] 2> 1136149 T2581 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4916c4a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@69988098),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1136149 T2581 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1136152 T2581 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1136153 T2581 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1136153 T2581 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1136154 T2581 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1136155 T2581 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1136155 T2581 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1136156 T2581 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1136156 T2581 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1136157 T2581 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1136170 T2581 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1136176 T2581 oass.SolrIndexSearcher.<init> Opening Searcher@39f43e8f main
[junit4:junit4] 2> 1136177 T2581 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/tlog
[junit4:junit4] 2> 1136182 T2581 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1136183 T2581 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1136187 T2582 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@39f43e8f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1136190 T2581 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1136190 T2581 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1136808 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1136809 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46477_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46477"}
[junit4:junit4] 2> 1136809 T2529 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1136809 T2529 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1136822 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1136822 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1136822 T2580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1136822 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1136822 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1137193 T2581 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1137193 T2581 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46477 collection:collection1 shard:shard1
[junit4:junit4] 2> 1137196 T2581 oasc.ZkController.register We are http://127.0.0.1:46477/collection1/ and leader is http://127.0.0.1:43852/collection1/
[junit4:junit4] 2> 1137196 T2581 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46477
[junit4:junit4] 2> 1137197 T2581 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1137197 T2581 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C138 name=collection1 org.apache.solr.core.SolrCore@6a8e751f url=http://127.0.0.1:46477/collection1 node=127.0.0.1:46477_ C138_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:46477_, base_url=http://127.0.0.1:46477}
[junit4:junit4] 2> 1137198 T2583 C138 P46477 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1137198 T2581 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1137199 T2583 C138 P46477 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1137199 T2583 C138 P46477 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1137200 T2583 C138 P46477 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1137200 T2506 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1137201 T2506 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1137201 T2583 C138 P46477 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1137201 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1137224 T2538 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1137440 T2506 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1137444 T2506 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:46287
[junit4:junit4] 2> 1137445 T2506 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1137446 T2506 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1137446 T2506 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368791804949
[junit4:junit4] 2> 1137447 T2506 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368791804949/solr.xml
[junit4:junit4] 2> 1137447 T2506 oasc.CoreContainer.<init> New CoreContainer 1908002999
[junit4:junit4] 2> 1137448 T2506 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368791804949/'
[junit4:junit4] 2> 1137449 T2506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368791804949/'
[junit4:junit4] 2> 1137566 T2506 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1137567 T2506 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1137567 T2506 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1137568 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1137568 T2506 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1137569 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1137569 T2506 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1137570 T2506 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1137571 T2506 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1137571 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1137611 T2506 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1137612 T2506 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43845/solr
[junit4:junit4] 2> 1137613 T2506 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1137614 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1137632 T2595 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28ecfef9 name:ZooKeeperConnection Watcher:127.0.0.1:43845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1137633 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1137641 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1137652 T2506 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1137654 T2597 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26332ef9 name:ZooKeeperConnection Watcher:127.0.0.1:43845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1137655 T2506 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1137666 T2506 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1138326 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1138327 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46477_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46477"}
[junit4:junit4] 2> 1138344 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1138344 T2580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1138344 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1138344 T2597 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1138344 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1138344 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1138670 T2506 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46287_
[junit4:junit4] 2> 1138678 T2506 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46287_
[junit4:junit4] 2> 1138680 T2597 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1138681 T2528 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1138680 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1138680 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1138681 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1138681 T2580 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1138681 T2548 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1138682 T2580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1138682 T2597 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1138683 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1138684 T2535 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1138684 T2564 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1138690 T2598 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368791804949/collection1
[junit4:junit4] 2> 1138690 T2598 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1138691 T2598 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1138691 T2598 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1138692 T2598 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368791804949/collection1/'
[junit4:junit4] 2> 1138694 T2598 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1368791804949/collection1/lib/README' to classloader
[junit4:junit4] 2> 1138694 T2598 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1368791804949/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1138747 T2598 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1138809 T2598 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1138910 T2598 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1138916 T2598 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1139227 T2538 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1139227 T2538 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:46477_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 1139519 T2598 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1139524 T2598 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1139526 T2598 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1139531 T2598 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1139551 T2598 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1139551 T2598 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368791804949/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4/
[junit4:junit4] 2> 1139552 T2598 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@171917ca
[junit4:junit4] 2> 1139553 T2598 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1139553 T2598 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4
[junit4:junit4] 2> 1139554 T2598 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4/index/
[junit4:junit4] 2> 1139554 T2598 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1139554 T2598 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4/index
[junit4:junit4] 2> 1139557 T2598 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@382047c4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b1944e8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1139558 T2598 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1139561 T2598 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1139561 T2598 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1139562 T2598 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1139563 T2598 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1139564 T2598 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1139564 T2598 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1139565 T2598 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1139565 T2598 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1139566 T2598 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1139581 T2598 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1139588 T2598 oass.SolrIndexSearcher.<init> Opening Searcher@1186d8c3 main
[junit4:junit4] 2> 1139588 T2598 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4/tlog
[junit4:junit4] 2> 1139589 T2598 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1139589 T2598 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1139594 T2599 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1186d8c3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1139596 T2598 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1139597 T2598 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1139848 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1139849 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46287_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46287"}
[junit4:junit4] 2> 1139849 T2529 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1139849 T2529 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1139863 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1139863 T2580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1139864 T2597 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1139863 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1139863 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1139863 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1140610 T2598 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1140610 T2598 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46287 collection:collection1 shard:shard2
[junit4:junit4] 2> 1140614 T2598 oasc.ZkController.register We are http://127.0.0.1:46287/collection1/ and leader is http://127.0.0.1:43859/collection1/
[junit4:junit4] 2> 1140614 T2598 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46287
[junit4:junit4] 2> 1140614 T2598 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1140614 T2598 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C139 name=collection1 org.apache.solr.core.SolrCore@7a0bb1cf url=http://127.0.0.1:46287/collection1 node=127.0.0.1:46287_ C139_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:46287_, base_url=http://127.0.0.1:46287}
[junit4:junit4] 2> 1140615 T2600 C139 P46287 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1140615 T2598 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1140616 T2600 C139 P46287 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1140616 T2600 C139 P46287 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1140617 T2600 C139 P46287 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1140617 T2506 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1140618 T2506 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1140618 T2600 C139 P46287 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1140618 T2506 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1140638 T2506 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1140639 T2554 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1140639 T2506 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1140640 T2506 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1140641 T2506 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C138_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:46477_, base_url=http://127.0.0.1:46477}
[junit4:junit4] 2> 1141229 T2583 C138 P46477 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43852/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1141229 T2583 C138 P46477 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:46477 START replicas=[http://127.0.0.1:43852/collection1/] nUpdates=100
[junit4:junit4] 2> 1141230 T2583 C138 P46477 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1141230 T2583 C138 P46477 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1141230 T2583 C138 P46477 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1141230 T2583 C138 P46477 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1141231 T2583 C138 P46477 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1141231 T2583 C138 P46477 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43852/collection1/. core=collection1
[junit4:junit4] 2> 1141231 T2583 C138 P46477 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C140 name=collection1 org.apache.solr.core.SolrCore@3e83300d url=http://127.0.0.1:43852/collection1 node=127.0.0.1:43852_ C140_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:43852_, base_url=http://127.0.0.1:43852, leader=true}
[junit4:junit4] 2> 1141240 T2539 C140 P43852 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1141243 T2540 C140 P43852 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1141246 T2540 C140 P43852 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2766a7aa lockFactory=org.apache.lucene.store.NativeFSLockFactory@16f5ded2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1141246 T2540 C140 P43852 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1141247 T2540 C140 P43852 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2766a7aa lockFactory=org.apache.lucene.store.NativeFSLockFactory@16f5ded2),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2766a7aa lockFactory=org.apache.lucene.store.NativeFSLockFactory@16f5ded2),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1141248 T2540 C140 P43852 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1141248 T2540 C140 P43852 oass.SolrIndexSearcher.<init> Opening Searcher@3050dc66 realtime
[junit4:junit4] 2> 1141249 T2540 C140 P43852 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1141249 T2540 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1141250 T2583 C138 P46477 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1141250 T2583 C138 P46477 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1141252 T2541 C140 P43852 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1141253 T2541 C140 P43852 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1141254 T2583 C138 P46477 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1141254 T2583 C138 P46477 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1141254 T2583 C138 P46477 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1141256 T2541 C140 P43852 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1141257 T2583 C138 P46477 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1141258 T2583 C138 P46477 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index.20130517195648983
[junit4:junit4] 2> 1141258 T2583 C138 P46477 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@17448820 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2501ac9e) fullCopy=false
[junit4:junit4] 2> 1141261 T2541 C140 P43852 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1141262 T2583 C138 P46477 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1141264 T2583 C138 P46477 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1141264 T2583 C138 P46477 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1141266 T2583 C138 P46477 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4916c4a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@69988098),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4916c4a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@69988098),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1141266 T2583 C138 P46477 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1141267 T2583 C138 P46477 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1141267 T2583 C138 P46477 oass.SolrIndexSearcher.<init> Opening Searcher@71cb04df main
[junit4:junit4] 2> 1141268 T2582 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@71cb04df main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1141269 T2583 C138 P46477 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index.20130517195648983 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index.20130517195648983;done=true>>]
[junit4:junit4] 2> 1141269 T2583 C138 P46477 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index.20130517195648983
[junit4:junit4] 2> 1141269 T2583 C138 P46477 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index.20130517195648983
[junit4:junit4] 2> 1141269 T2583 C138 P46477 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1141270 T2583 C138 P46477 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1141270 T2583 C138 P46477 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1141270 T2583 C138 P46477 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1141298 T2583 C138 P46477 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1141368 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1141368 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46287_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46287"}
[junit4:junit4] 2> 1141371 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46477_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46477"}
[junit4:junit4] 2> 1141383 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1141383 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1141383 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1141383 T2597 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1141383 T2580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1141383 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1141640 T2554 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1141640 T2554 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:46287_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 1141642 T2506 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1142644 T2506 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C139_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:46287_, base_url=http://127.0.0.1:46287}
[junit4:junit4] 2> 1143642 T2600 C139 P46287 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43859/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1143642 T2600 C139 P46287 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:46287 START replicas=[http://127.0.0.1:43859/collection1/] nUpdates=100
[junit4:junit4] 2> 1143643 T2600 C139 P46287 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1143643 T2600 C139 P46287 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1143643 T2600 C139 P46287 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1143643 T2600 C139 P46287 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1143644 T2600 C139 P46287 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1143644 T2600 C139 P46287 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43859/collection1/. core=collection1
[junit4:junit4] 2> 1143644 T2600 C139 P46287 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1143646 T2506 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C141 name=collection1 org.apache.solr.core.SolrCore@298b9b90 url=http://127.0.0.1:43859/collection1 node=127.0.0.1:43859_ C141_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:43859_, base_url=http://127.0.0.1:43859, leader=true}
[junit4:junit4] 2> 1143652 T2555 C141 P43859 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1143656 T2556 C141 P43859 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1143659 T2556 C141 P43859 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69d97a9b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c811134),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1143660 T2556 C141 P43859 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1143661 T2556 C141 P43859 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69d97a9b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c811134),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69d97a9b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c811134),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1143661 T2556 C141 P43859 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1143662 T2556 C141 P43859 oass.SolrIndexSearcher.<init> Opening Searcher@5b37c1a8 realtime
[junit4:junit4] 2> 1143662 T2556 C141 P43859 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1143663 T2556 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1143664 T2600 C139 P46287 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1143664 T2600 C139 P46287 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1143666 T2557 C141 P43859 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1143666 T2557 C141 P43859 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1143667 T2600 C139 P46287 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1143667 T2600 C139 P46287 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1143667 T2600 C139 P46287 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1143670 T2557 C141 P43859 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1143671 T2600 C139 P46287 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1143672 T2600 C139 P46287 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4/index.20130517195651397
[junit4:junit4] 2> 1143672 T2600 C139 P46287 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@210928cd lockFactory=org.apache.lucene.store.NativeFSLockFactory@4bae9813) fullCopy=false
[junit4:junit4] 2> 1143675 T2557 C141 P43859 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1143676 T2600 C139 P46287 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1143677 T2600 C139 P46287 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1143677 T2600 C139 P46287 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1143679 T2600 C139 P46287 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@382047c4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b1944e8),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@382047c4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b1944e8),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1143680 T2600 C139 P46287 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1143680 T2600 C139 P46287 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1143680 T2600 C139 P46287 oass.SolrIndexSearcher.<init> Opening Searcher@2f04dd70 main
[junit4:junit4] 2> 1143681 T2599 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f04dd70 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1143682 T2600 C139 P46287 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4/index.20130517195651397 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4/index.20130517195651397;done=true>>]
[junit4:junit4] 2> 1143682 T2600 C139 P46287 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4/index.20130517195651397
[junit4:junit4] 2> 1143682 T2600 C139 P46287 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty4/index.20130517195651397
[junit4:junit4] 2> 1143683 T2600 C139 P46287 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1143683 T2600 C139 P46287 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1143683 T2600 C139 P46287 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1143683 T2600 C139 P46287 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1143687 T2600 C139 P46287 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1144398 T2529 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1144399 T2529 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46287_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46287"}
[junit4:junit4] 2> 1144416 T2528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1144416 T2564 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1144416 T2597 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1144416 T2580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1144416 T2535 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1144416 T2548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1144648 T2506 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1144649 T2506 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C142 name=collection1 org.apache.solr.core.SolrCore@cd54686 url=http://127.0.0.1:43848/collection1 node=127.0.0.1:43848_ C142_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:43848_, base_url=http://127.0.0.1:43848, leader=true}
[junit4:junit4] 2> 1144658 T2518 C142 P43848 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1144662 T2518 C142 P43848 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76a08c0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1adbc15),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1144662 T2518 C142 P43848 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1144663 T2518 C142 P43848 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76a08c0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1adbc15),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76a08c0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1adbc15),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1144664 T2518 C142 P43848 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1144664 T2518 C142 P43848 oass.SolrIndexSearcher.<init> Opening Searcher@589a70ab main
[junit4:junit4] 2> 1144665 T2518 C142 P43848 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1144666 T2532 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@589a70ab main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1144666 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1144678 T2542 C140 P43852 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1144679 T2542 C140 P43852 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2766a7aa lockFactory=org.apache.lucene.store.NativeFSLockFactory@16f5ded2),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2766a7aa lockFactory=org.apache.lucene.store.NativeFSLockFactory@16f5ded2),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1144680 T2542 C140 P43852 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1144680 T2542 C140 P43852 oass.SolrIndexSearcher.<init> Opening Searcher@2b9bfb5d main
[junit4:junit4] 2> 1144681 T2542 C140 P43852 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1144682 T2550 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b9bfb5d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1144682 T2542 C140 P43852 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:46477/collection1/, StdNode: http://127.0.0.1:43859/collection1/, StdNode: http://127.0.0.1:46287/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1144686 T2558 C141 P43859 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1144687 T2558 C141 P43859 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69d97a9b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c811134),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69d97a9b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c811134),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1144687 T2558 C141 P43859 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1144688 T2558 C141 P43859 oass.SolrIndexSearcher.<init> Opening Searcher@253fd42 main
[junit4:junit4] 2> 1144689 T2558 C141 P43859 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1144689 T2566 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@253fd42 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1144690 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C138_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46477_, base_url=http://127.0.0.1:46477}
[junit4:junit4] 2> 1144693 T2570 C138 P46477 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C139_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46287_, base_url=http://127.0.0.1:46287}
[junit4:junit4] 2> 1144693 T2587 C139 P46287 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1144694 T2570 C138 P46477 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4916c4a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@69988098),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4916c4a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@69988098),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1144695 T2587 C139 P46287 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@382047c4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b1944e8),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@382047c4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3b1944e8),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1144695 T2570 C138 P46477 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1144696 T2587 C139 P46287 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1144697 T2570 C138 P46477 oass.SolrIndexSearcher.<init> Opening Searcher@584f7260 main
[junit4:junit4] 2> 1144697 T2587 C139 P46287 oass.SolrIndexSearcher.<init> Opening Searcher@418ac1fe main
[junit4:junit4] 2> 1144698 T2570 C138 P46477 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1144698 T2587 C139 P46287 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1144699 T2599 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@418ac1fe main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1144698 T2582 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@584f7260 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1144699 T2587 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1144700 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1144700 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 1144701 T2506 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1144704 T2543 C140 P43852 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1144706 T2571 C138 P46477 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1144707 T2559 C141 P43859 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1144709 T2588 C139 P46287 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1146714 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435282245616140288)} 0 2
[junit4:junit4] 2> 1146722 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435282245621383168&update.from=http://127.0.0.1:43852/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435282245621383168)} 0 1
[junit4:junit4] 2> 1146726 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435282245625577472&update.from=http://127.0.0.1:43859/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435282245625577472)} 0 1
[junit4:junit4] 2> 1146727 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435282245625577472)} 0 5
[junit4:junit4] 2> 1146727 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435282245621383168)} 0 10
[junit4:junit4] 2> 1146731 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1435282245635014656)]} 0 1
[junit4:junit4] 2> 1146735 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435282245637111808)]} 0 0
[junit4:junit4] 2> 1146736 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1435282245637111808)]} 0 4
[junit4:junit4] 2> 1146739 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435282245644451840)]} 0 0
[junit4:junit4] 2> 1146744 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435282245647597568)]} 0 0
[junit4:junit4] 2> 1146745 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435282245647597568)]} 0 3
[junit4:junit4] 2> 1146747 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435282245652840448)]} 0 0
[junit4:junit4] 2> 1146752 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435282245655986176)]} 0 0
[junit4:junit4] 2> 1146753 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435282245655986176)]} 0 3
[junit4:junit4] 2> 1146755 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435282245661229056)]} 0 0
[junit4:junit4] 2> 1146760 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435282245664374784)]} 0 0
[junit4:junit4] 2> 1146761 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435282245664374784)]} 0 3
[junit4:junit4] 2> 1146763 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435282245669617664)]} 0 0
[junit4:junit4] 2> 1146768 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435282245672763392)]} 0 0
[junit4:junit4] 2> 1146769 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435282245672763392)]} 0 3
[junit4:junit4] 2> 1146771 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435282245678006272)]} 0 0
[junit4:junit4] 2> 1146778 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435282245683249152)]} 0 0
[junit4:junit4] 2> 1146779 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1435282245683249152)]} 0 3
[junit4:junit4] 2> 1146779 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5]} 0 5
[junit4:junit4] 2> 1146782 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1435282245689540608)]} 0 0
[junit4:junit4] 2> 1146789 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435282245693734912)]} 0 0
[junit4:junit4] 2> 1146790 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1435282245693734912)]} 0 4
[junit4:junit4] 2> 1146790 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6]} 0 5
[junit4:junit4] 2> 1146793 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435282245701074944)]} 0 0
[junit4:junit4] 2> 1146798 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435282245704220672)]} 0 0
[junit4:junit4] 2> 1146799 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435282245704220672)]} 0 3
[junit4:junit4] 2> 1146801 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435282245709463552)]} 0 0
[junit4:junit4] 2> 1146806 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435282245712609280)]} 0 0
[junit4:junit4] 2> 1146807 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435282245712609280)]} 0 3
[junit4:junit4] 2> 1146809 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435282245717852160)]} 0 0
[junit4:junit4] 2> 1146816 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435282245723095040)]} 0 0
[junit4:junit4] 2> 1146817 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!9 (1435282245723095040)]} 0 3
[junit4:junit4] 2> 1146817 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9]} 0 5
[junit4:junit4] 2> 1146820 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1435282245729386496)]} 0 0
[junit4:junit4] 2> 1146827 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435282245734629376)]} 0 0
[junit4:junit4] 2> 1146828 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1435282245734629376)]} 0 3
[junit4:junit4] 2> 1146828 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10]} 0 5
[junit4:junit4] 2> 1146831 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435282245740920832)]} 0 0
[junit4:junit4] 2> 1146836 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435282245744066560)]} 0 0
[junit4:junit4] 2> 1146837 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435282245744066560)]} 0 3
[junit4:junit4] 2> 1146839 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435282245749309440)]} 0 0
[junit4:junit4] 2> 1146846 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435282245754552320)]} 0 0
[junit4:junit4] 2> 1146847 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1435282245754552320)]} 0 3
[junit4:junit4] 2> 1146847 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12]} 0 5
[junit4:junit4] 2> 1146850 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435282245760843776)]} 0 0
[junit4:junit4] 2> 1146855 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435282245763989504)]} 0 0
[junit4:junit4] 2> 1146856 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435282245763989504)]} 0 3
[junit4:junit4] 2> 1146858 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435282245769232384)]} 0 0
[junit4:junit4] 2> 1146863 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435282245772378112)]} 0 0
[junit4:junit4] 2> 1146864 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435282245772378112)]} 0 3
[junit4:junit4] 2> 1146866 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435282245777620992)]} 0 0
[junit4:junit4] 2> 1146871 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435282245780766720)]} 0 0
[junit4:junit4] 2> 1146872 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435282245780766720)]} 0 3
[junit4:junit4] 2> 1146874 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435282245786009600)]} 0 0
[junit4:junit4] 2> 1146881 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435282245791252480)]} 0 0
[junit4:junit4] 2> 1146882 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1435282245791252480)]} 0 3
[junit4:junit4] 2> 1146882 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16]} 0 5
[junit4:junit4] 2> 1146885 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435282245797543936)]} 0 0
[junit4:junit4] 2> 1146892 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435282245802786816)]} 0 0
[junit4:junit4] 2> 1146893 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!17 (1435282245802786816)]} 0 3
[junit4:junit4] 2> 1146893 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17]} 0 5
[junit4:junit4] 2> 1146896 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1435282245809078272)]} 0 0
[junit4:junit4] 2> 1146901 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435282245812224000)]} 0 0
[junit4:junit4] 2> 1146902 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1435282245812224000)]} 0 3
[junit4:junit4] 2> 1146904 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435282245817466880)]} 0 0
[junit4:junit4] 2> 1146909 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435282245820612608)]} 0 0
[junit4:junit4] 2> 1146910 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435282245820612608)]} 0 3
[junit4:junit4] 2> 1146912 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1435282245825855488)]} 0 0
[junit4:junit4] 2> 1146917 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435282245829001216)]} 0 0
[junit4:junit4] 2> 1146918 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1435282245829001216)]} 0 3
[junit4:junit4] 2> 1146920 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435282245834244096)]} 0 0
[junit4:junit4] 2> 1146925 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435282245837389824)]} 0 0
[junit4:junit4] 2> 1146926 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435282245837389824)]} 0 3
[junit4:junit4] 2> 1146928 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435282245842632704)]} 0 0
[junit4:junit4] 2> 1146933 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435282245845778432)]} 0 0
[junit4:junit4] 2> 1146934 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435282245845778432)]} 0 3
[junit4:junit4] 2> 1146937 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435282245852069888)]} 0 0
[junit4:junit4] 2> 1146942 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435282245855215616)]} 0 0
[junit4:junit4] 2> 1146943 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435282245855215616)]} 0 3
[junit4:junit4] 2> 1146945 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1435282245860458496)]} 0 0
[junit4:junit4] 2> 1146952 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435282245865701376)]} 0 0
[junit4:junit4] 2> 1146953 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1435282245865701376)]} 0 3
[junit4:junit4] 2> 1146953 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24]} 0 5
[junit4:junit4] 2> 1146956 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435282245871992832)]} 0 0
[junit4:junit4] 2> 1146963 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435282245877235712)]} 0 0
[junit4:junit4] 2> 1146964 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1435282245877235712)]} 0 3
[junit4:junit4] 2> 1146964 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25]} 0 5
[junit4:junit4] 2> 1146967 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435282245883527168)]} 0 0
[junit4:junit4] 2> 1146972 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435282245886672896)]} 0 0
[junit4:junit4] 2> 1146973 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435282245886672896)]} 0 3
[junit4:junit4] 2> 1146975 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1435282245891915776)]} 0 0
[junit4:junit4] 2> 1146982 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435282245897158656)]} 0 0
[junit4:junit4] 2> 1146983 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1435282245897158656)]} 0 3
[junit4:junit4] 2> 1146983 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 5
[junit4:junit4] 2> 1146986 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435282245903450112)]} 0 0
[junit4:junit4] 2> 1146993 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435282245908692992)]} 0 0
[junit4:junit4] 2> 1146994 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1435282245908692992)]} 0 3
[junit4:junit4] 2> 1146994 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 5
[junit4:junit4] 2> 1146997 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1435282245914984448)]} 0 0
[junit4:junit4] 2> 1147002 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435282245918130176)]} 0 0
[junit4:junit4] 2> 1147003 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1435282245918130176)]} 0 3
[junit4:junit4] 2> 1147005 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435282245923373056)]} 0 0
[junit4:junit4] 2> 1147012 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435282245928615936)]} 0 0
[junit4:junit4] 2> 1147013 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!30 (1435282245928615936)]} 0 3
[junit4:junit4] 2> 1147013 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30]} 0 5
[junit4:junit4] 2> 1147016 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435282245934907392)]} 0 0
[junit4:junit4] 2> 1147021 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435282245938053120)]} 0 0
[junit4:junit4] 2> 1147022 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435282245938053120)]} 0 3
[junit4:junit4] 2> 1147024 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435282245943296000)]} 0 0
[junit4:junit4] 2> 1147029 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435282245946441728)]} 0 0
[junit4:junit4] 2> 1147030 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435282245946441728)]} 0 3
[junit4:junit4] 2> 1147032 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1435282245951684608)]} 0 0
[junit4:junit4] 2> 1147039 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435282245956927488)]} 0 0
[junit4:junit4] 2> 1147040 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1435282245956927488)]} 0 3
[junit4:junit4] 2> 1147040 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33]} 0 5
[junit4:junit4] 2> 1147043 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435282245963218944)]} 0 0
[junit4:junit4] 2> 1147048 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435282245966364672)]} 0 0
[junit4:junit4] 2> 1147049 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435282245966364672)]} 0 3
[junit4:junit4] 2> 1147051 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435282245971607552)]} 0 0
[junit4:junit4] 2> 1147058 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435282245976850432)]} 0 0
[junit4:junit4] 2> 1147059 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!35 (1435282245976850432)]} 0 3
[junit4:junit4] 2> 1147059 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35]} 0 5
[junit4:junit4] 2> 1147062 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435282245983141888)]} 0 0
[junit4:junit4] 2> 1147069 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1435282245988384768)]} 0 0
[junit4:junit4] 2> 1147070 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1435282245988384768)]} 0 3
[junit4:junit4] 2> 1147070 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36]} 0 5
[junit4:junit4] 2> 1147073 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1435282245994676224)]} 0 0
[junit4:junit4] 2> 1147078 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1435282245997821952)]} 0 0
[junit4:junit4] 2> 1147079 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1435282245997821952)]} 0 3
[junit4:junit4] 2> 1147081 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435282246003064832)]} 0 0
[junit4:junit4] 2> 1147086 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1435282246006210560)]} 0 0
[junit4:junit4] 2> 1147087 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435282246006210560)]} 0 3
[junit4:junit4] 2> 1147089 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1435282246011453440)]} 0 0
[junit4:junit4] 2> 1147096 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1435282246016696320)]} 0 0
[junit4:junit4] 2> 1147097 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1435282246016696320)]} 0 3
[junit4:junit4] 2> 1147097 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39]} 0 5
[junit4:junit4] 2> 1147100 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435282246022987776)]} 0 0
[junit4:junit4] 2> 1147105 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1435282246026133504)]} 0 0
[junit4:junit4] 2> 1147106 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435282246026133504)]} 0 3
[junit4:junit4] 2> 1147108 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1435282246031376384)]} 0 0
[junit4:junit4] 2> 1147113 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1435282246034522112)]} 0 0
[junit4:junit4] 2> 1147114 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1435282246034522112)]} 0 3
[junit4:junit4] 2> 1147116 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435282246039764992)]} 0 0
[junit4:junit4] 2> 1147121 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1435282246042910720)]} 0 0
[junit4:junit4] 2> 1147122 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435282246042910720)]} 0 3
[junit4:junit4] 2> 1147125 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435282246049202176)]} 0 0
[junit4:junit4] 2> 1147130 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1435282246052347904)]} 0 0
[junit4:junit4] 2> 1147131 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435282246052347904)]} 0 3
[junit4:junit4] 2> 1147133 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435282246057590784)]} 0 0
[junit4:junit4] 2> 1147138 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1435282246060736512)]} 0 0
[junit4:junit4] 2> 1147139 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435282246060736512)]} 0 3
[junit4:junit4] 2> 1147141 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435282246065979392)]} 0 0
[junit4:junit4] 2> 1147146 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1435282246069125120)]} 0 0
[junit4:junit4] 2> 1147147 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435282246069125120)]} 0 3
[junit4:junit4] 2> 1147149 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435282246074368000)]} 0 0
[junit4:junit4] 2> 1147156 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1435282246079610880)]} 0 0
[junit4:junit4] 2> 1147157 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!46 (1435282246079610880)]} 0 3
[junit4:junit4] 2> 1147157 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46]} 0 5
[junit4:junit4] 2> 1147160 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1435282246085902336)]} 0 0
[junit4:junit4] 2> 1147165 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1435282246089048064)]} 0 0
[junit4:junit4] 2> 1147166 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1435282246089048064)]} 0 3
[junit4:junit4] 2> 1147168 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435282246094290944)]} 0 0
[junit4:junit4] 2> 1147173 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1435282246097436672)]} 0 0
[junit4:junit4] 2> 1147174 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435282246097436672)]} 0 3
[junit4:junit4] 2> 1147177 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1435282246103728128)]} 0 0
[junit4:junit4] 2> 1147184 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1435282246108971008)]} 0 0
[junit4:junit4] 2> 1147185 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1435282246108971008)]} 0 3
[junit4:junit4] 2> 1147185 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49]} 0 5
[junit4:junit4] 2> 1147188 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435282246115262464)]} 0 0
[junit4:junit4] 2> 1147195 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1435282246120505344)]} 0 0
[junit4:junit4] 2> 1147196 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!50 (1435282246120505344)]} 0 3
[junit4:junit4] 2> 1147196 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50]} 0 5
[junit4:junit4] 2> 1147199 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435282246126796800)]} 0 0
[junit4:junit4] 2> 1147204 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1435282246129942528)]} 0 0
[junit4:junit4] 2> 1147205 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435282246129942528)]} 0 3
[junit4:junit4] 2> 1147207 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435282246135185408)]} 0 0
[junit4:junit4] 2> 1147214 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1435282246140428288)]} 0 0
[junit4:junit4] 2> 1147215 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!52 (1435282246140428288)]} 0 3
[junit4:junit4] 2> 1147215 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52]} 0 5
[junit4:junit4] 2> 1147218 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435282246146719744)]} 0 0
[junit4:junit4] 2> 1147225 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1435282246151962624)]} 0 0
[junit4:junit4] 2> 1147226 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1435282246151962624)]} 0 3
[junit4:junit4] 2> 1147226 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53]} 0 5
[junit4:junit4] 2> 1147229 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435282246158254080)]} 0 0
[junit4:junit4] 2> 1147234 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1435282246161399808)]} 0 0
[junit4:junit4] 2> 1147235 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435282246161399808)]} 0 3
[junit4:junit4] 2> 1147237 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435282246166642688)]} 0 0
[junit4:junit4] 2> 1147242 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1435282246169788416)]} 0 0
[junit4:junit4] 2> 1147243 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435282246169788416)]} 0 3
[junit4:junit4] 2> 1147245 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1435282246175031296)]} 0 0
[junit4:junit4] 2> 1147252 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1435282246180274176)]} 0 0
[junit4:junit4] 2> 1147253 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1435282246180274176)]} 0 3
[junit4:junit4] 2> 1147253 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 5
[junit4:junit4] 2> 1147256 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435282246186565632)]} 0 0
[junit4:junit4] 2> 1147261 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1435282246189711360)]} 0 0
[junit4:junit4] 2> 1147262 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435282246189711360)]} 0 3
[junit4:junit4] 2> 1147264 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435282246194954240)]} 0 0
[junit4:junit4] 2> 1147271 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1435282246200197120)]} 0 0
[junit4:junit4] 2> 1147272 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1435282246200197120)]} 0 3
[junit4:junit4] 2> 1147272 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58]} 0 5
[junit4:junit4] 2> 1147275 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435282246206488576)]} 0 0
[junit4:junit4] 2> 1147282 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1435282246211731456)]} 0 0
[junit4:junit4] 2> 1147283 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!59 (1435282246211731456)]} 0 3
[junit4:junit4] 2> 1147283 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59]} 0 5
[junit4:junit4] 2> 1147286 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1435282246218022912)]} 0 0
[junit4:junit4] 2> 1147291 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1435282246221168640)]} 0 0
[junit4:junit4] 2> 1147292 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1435282246221168640)]} 0 3
[junit4:junit4] 2> 1147294 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435282246226411520)]} 0 0
[junit4:junit4] 2> 1147301 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1435282246231654400)]} 0 0
[junit4:junit4] 2> 1147302 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!61 (1435282246231654400)]} 0 3
[junit4:junit4] 2> 1147302 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61]} 0 5
[junit4:junit4] 2> 1147305 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435282246237945856)]} 0 0
[junit4:junit4] 2> 1147310 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1435282246241091584)]} 0 0
[junit4:junit4] 2> 1147311 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435282246241091584)]} 0 3
[junit4:junit4] 2> 1147314 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1435282246247383040)]} 0 0
[junit4:junit4] 2> 1147322 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1435282246253674496)]} 0 0
[junit4:junit4] 2> 1147323 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!63 (1435282246253674496)]} 0 4
[junit4:junit4] 2> 1147323 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63]} 0 6
[junit4:junit4] 2> 1147326 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1435282246259965952)]} 0 0
[junit4:junit4] 2> 1147331 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1435282246263111680)]} 0 0
[junit4:junit4] 2> 1147332 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1435282246263111680)]} 0 3
[junit4:junit4] 2> 1147334 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435282246268354560)]} 0 0
[junit4:junit4] 2> 1147339 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1435282246271500288)]} 0 0
[junit4:junit4] 2> 1147340 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435282246271500288)]} 0 3
[junit4:junit4] 2> 1147342 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1435282246276743168)]} 0 0
[junit4:junit4] 2> 1147349 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1435282246281986048)]} 0 0
[junit4:junit4] 2> 1147350 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1435282246281986048)]} 0 3
[junit4:junit4] 2> 1147350 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66]} 0 5
[junit4:junit4] 2> 1147353 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1435282246288277504)]} 0 0
[junit4:junit4] 2> 1147360 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1435282246293520384)]} 0 0
[junit4:junit4] 2> 1147361 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!67 (1435282246293520384)]} 0 3
[junit4:junit4] 2> 1147361 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67]} 0 5
[junit4:junit4] 2> 1147364 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1435282246299811840)]} 0 0
[junit4:junit4] 2> 1147371 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1435282246305054720)]} 0 0
[junit4:junit4] 2> 1147372 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!68 (1435282246305054720)]} 0 3
[junit4:junit4] 2> 1147372 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68]} 0 5
[junit4:junit4] 2> 1147375 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69 (1435282246311346176)]} 0 0
[junit4:junit4] 2> 1147382 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!69 (1435282246316589056)]} 0 0
[junit4:junit4] 2> 1147383 T2558 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!69 (1435282246316589056)]} 0 3
[junit4:junit4] 2> 1147383 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69]} 0 5
[junit4:junit4] 2> 1147386 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!70 (1435282246322880512)]} 0 0
[junit4:junit4] 2> 1147393 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!70 (1435282246328123392)]} 0 0
[junit4:junit4] 2> 1147394 T2544 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!70 (1435282246328123392)]} 0 3
[junit4:junit4] 2> 1147394 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!70]} 0 5
[junit4:junit4] 2> 1147397 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!71 (1435282246334414848)]} 0 0
[junit4:junit4] 2> 1147402 T2570 C138 P46477 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43852/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!71 (1435282246337560576)]} 0 0
[junit4:junit4] 2> 1147403 T2542 C140 P43852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!71 (1435282246337560576)]} 0 3
[junit4:junit4] 2> 1147405 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!72 (1435282246342803456)]} 0 0
[junit4:junit4] 2> 1147410 T2589 C139 P46287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:43859/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!72 (1435282246345949184)]} 0 0
[junit4:junit4] 2> 1147411 T2560 C141 P43859 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!72 (1435282246345949184)]} 0 3
[junit4:junit4] 2> 1147413 T2518 C142 P43848 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!73 (1435282246351192064)]} 0 0
[junit4:junit4] 2> 1147420 T2570 C138 P46477 oasup.LogUpdateProcess
[...truncated too long message...]
:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=DD2405EC2AAE3678 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hr -Dtests.timezone=Singapore -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 35.6s J1 | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:43852 returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([DD2405EC2AAE3678:5CC28BF45DF15644]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1156343 T2506 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 1182920 T2580 oasu.PeerSync.handleResponse WARN PeerSync: core=collection1 url=http://127.0.0.1:46477 couldn't connect to http://127.0.0.1:43852/collection1/, counting as success
[junit4:junit4] 2> 1182921 T2580 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:46477 DONE. sync succeeded
[junit4:junit4] 2> 1182921 T2580 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1182921 T2580 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4:junit4] 2> 1182921 T2580 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@6a8e751f
[junit4:junit4] 2> 1182923 T2580 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=10,adds=10,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=69,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1182924 T2580 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1182924 T2580 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1182924 T2580 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1182927 T2580 C138 P46477 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4916c4a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@69988098),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4916c4a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@69988098),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1182927 T2580 C138 P46477 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1182930 T2580 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1182930 T2580 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1182931 T2580 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3;done=false>>]
[junit4:junit4] 2> 1182931 T2580 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3
[junit4:junit4] 2> 1182931 T2580 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index;done=false>>]
[junit4:junit4] 2> 1182931 T2580 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368791788481/jetty3/index
[junit4:junit4] 2> 1182932 T2580 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1182932 T2580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1182932 T2580 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1182932 T2580 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1182933 T2580 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1182933 T2580 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=hr, timezone=Singapore
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=2,free=232403584,total=437256192
[junit4:junit4] 2> NOTE: All tests run in this JVM: [AliasIntegrationTest, RequiredFieldsTest, MoreLikeThisHandlerTest, IndexSchemaRuntimeFieldTest, TestJoin, TestFieldTypeCollectionResource, UpdateRequestProcessorFactoryTest, TestCodecSupport, TestRangeQuery, DocumentAnalysisRequestHandlerTest, ClusterStateTest, TestBinaryField, TestManagedSchema, TestCSVLoader, TestOmitPositions, TestHashPartitioner, TestSolrJ, StandardRequestHandlerTest, TestSolrXMLSerializer, TestStressRecovery, DistributedQueryElevationComponentTest, DocValuesMultiTest, TestSerializedLuceneMatchVersion, BasicDistributedZk2Test, IndexReaderFactoryTest, ZkSolrClientTest, CoreContainerCoreInitFailuresTest, SampleTest, TestExtendedDismaxParser, TestReload, ConvertedLegacyTest, TestBinaryResponseWriter, ZkControllerTest, TestCharFilters, UniqFieldsUpdateProcessorFactoryTest, SynonymTokenizerTest, NotRequiredUniqueKeyTest, SoftAutoCommitTest, TestComponentsName, ShardRoutingCustomTest, TestLMDirichletSimilarityFactory, TestPartialUpdateDeduplication, TestFieldCollectionResource, FieldMutatingUpdateProcessorTest, TestMultiCoreConfBootstrap, TestSolr4Spatial, PathHierarchyTokenizerFactoryTest, ShowFileRequestHandlerTest, TermVectorComponentDistributedTest, SuggesterTSTTest, TestAddFieldRealTimeGet, WordBreakSolrSpellCheckerTest, DistanceFunctionTest, TestSolrDeletionPolicy1, ChaosMonkeySafeLeaderTest, TestSolrIndexConfig, ScriptEngineTest, TestTrie, TestLazyCores, TestCollationField, TestConfig, TestRandomFaceting, SuggesterTest, IndexBasedSpellCheckerTest, PrimUtilsTest, ChaosMonkeyNothingIsSafeTest, OverseerTest, TestAtomicUpdateErrorCases, TestReversedWildcardFilterFactory, SolrIndexConfigTest, TestSurroundQueryParser, ShardSplitTest]
[junit4:junit4] Completed on J1 in 62.65s, 1 test, 1 error <<< FAILURES!
[...truncated 463 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 27 ignored (8 assumptions)
Total time: 49 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1256 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1256/
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:55332/nfucv/im returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:55332/nfucv/im returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([68EED703CFCAC5F3:E908591BB895A5CF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9592 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 725580 T1876 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /nfucv/im
[junit4:junit4] 2> 725585 T1876 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1368777095430
[junit4:junit4] 2> 725586 T1876 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 725587 T1877 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 725687 T1876 oasc.ZkTestServer.run start zk server on port:50344
[junit4:junit4] 2> 725687 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 725691 T1883 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51b4239c name:ZooKeeperConnection Watcher:127.0.0.1:50344 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 725691 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 725691 T1876 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 725695 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 725704 T1885 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3421012d name:ZooKeeperConnection Watcher:127.0.0.1:50344/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 725704 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 725705 T1876 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 725708 T1876 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 725717 T1876 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 725720 T1876 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 725727 T1876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 725728 T1876 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 725740 T1876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 725741 T1876 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 725844 T1876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 725844 T1876 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 725854 T1876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 725854 T1876 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 725857 T1876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 725857 T1876 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 725860 T1876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 725860 T1876 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 725863 T1876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 725864 T1876 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 725871 T1876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 725872 T1876 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 725874 T1876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 725875 T1876 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 726023 T1876 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 726027 T1876 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:47447
[junit4:junit4] 2> 726028 T1876 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 726028 T1876 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 726028 T1876 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368777095724
[junit4:junit4] 2> 726029 T1876 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368777095724/solr.xml
[junit4:junit4] 2> 726029 T1876 oasc.CoreContainer.<init> New CoreContainer 2077556906
[junit4:junit4] 2> 726030 T1876 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368777095724/'
[junit4:junit4] 2> 726030 T1876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368777095724/'
[junit4:junit4] 2> 726108 T1876 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 726109 T1876 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 726109 T1876 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 726109 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 726110 T1876 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 726110 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 726110 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 726111 T1876 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 726111 T1876 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 726111 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 726122 T1876 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 726123 T1876 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50344/solr
[junit4:junit4] 2> 726123 T1876 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 726124 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 726128 T1896 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bad165f name:ZooKeeperConnection Watcher:127.0.0.1:50344 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 726129 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 726131 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 726139 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 726141 T1898 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59d4d5b6 name:ZooKeeperConnection Watcher:127.0.0.1:50344/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 726141 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 726143 T1876 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 726153 T1876 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 726156 T1876 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 726164 T1876 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47447_nfucv%2Fim
[junit4:junit4] 2> 726165 T1876 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47447_nfucv%2Fim
[junit4:junit4] 2> 726173 T1876 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 726186 T1876 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 726189 T1876 oasc.Overseer.start Overseer (id=89704175726493699-127.0.0.1:47447_nfucv%2Fim-n_0000000000) starting
[junit4:junit4] 2> 726199 T1876 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 726210 T1900 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 726210 T1876 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 726213 T1876 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 726220 T1876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 726227 T1901 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368777095724/collection1
[junit4:junit4] 2> 726227 T1899 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 726227 T1901 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 726228 T1901 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 726228 T1901 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 726229 T1901 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368777095724/collection1/'
[junit4:junit4] 2> 726230 T1901 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368777095724/collection1/lib/README' to classloader
[junit4:junit4] 2> 726231 T1901 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368777095724/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 726266 T1901 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 726316 T1901 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 726417 T1901 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 726422 T1901 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 727028 T1901 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 727032 T1901 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 727034 T1901 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 727040 T1901 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 727064 T1901 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 727065 T1901 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368777095724/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/control/data/
[junit4:junit4] 2> 727066 T1901 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1623a187
[junit4:junit4] 2> 727066 T1901 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 727067 T1901 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/control/data
[junit4:junit4] 2> 727067 T1901 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/control/data/index/
[junit4:junit4] 2> 727068 T1901 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 727068 T1901 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/control/data/index
[junit4:junit4] 2> 727072 T1901 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@596f31a3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63b35223),segFN=segments_1,generation=1}
[junit4:junit4] 2> 727072 T1901 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 727075 T1901 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 727075 T1901 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 727076 T1901 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 727077 T1901 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 727078 T1901 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 727078 T1901 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 727078 T1901 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 727079 T1901 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 727079 T1901 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 727093 T1901 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 727099 T1901 oass.SolrIndexSearcher.<init> Opening Searcher@3408222d main
[junit4:junit4] 2> 727099 T1901 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/control/data/tlog
[junit4:junit4] 2> 727100 T1901 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 727101 T1901 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 727104 T1902 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3408222d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 727107 T1901 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 727107 T1901 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 727731 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 727732 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47447_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47447/nfucv/im"}
[junit4:junit4] 2> 727733 T1899 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 727733 T1899 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 727749 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 728143 T1901 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 728143 T1901 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47447/nfucv/im collection:control_collection shard:shard1
[junit4:junit4] 2> 728144 T1901 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 728166 T1901 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 728170 T1901 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 728170 T1901 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 728170 T1901 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47447/nfucv/im/collection1/
[junit4:junit4] 2> 728171 T1901 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 728171 T1901 oasc.SyncStrategy.syncToMe http://127.0.0.1:47447/nfucv/im/collection1/ has no replicas
[junit4:junit4] 2> 728171 T1901 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47447/nfucv/im/collection1/
[junit4:junit4] 2> 728172 T1901 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 729253 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 729273 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 729310 T1901 oasc.ZkController.register We are http://127.0.0.1:47447/nfucv/im/collection1/ and leader is http://127.0.0.1:47447/nfucv/im/collection1/
[junit4:junit4] 2> 729310 T1901 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47447/nfucv/im
[junit4:junit4] 2> 729311 T1901 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 729311 T1901 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 729311 T1901 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 729313 T1901 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 729314 T1876 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 729315 T1876 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 729316 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 729331 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 729333 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 729335 T1905 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5332c0a name:ZooKeeperConnection Watcher:127.0.0.1:50344/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 729335 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 729337 T1876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 729339 T1876 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 729562 T1876 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 729566 T1876 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55332
[junit4:junit4] 2> 729567 T1876 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 729568 T1876 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 729568 T1876 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368777099183
[junit4:junit4] 2> 729569 T1876 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368777099183/solr.xml
[junit4:junit4] 2> 729569 T1876 oasc.CoreContainer.<init> New CoreContainer 1203822074
[junit4:junit4] 2> 729570 T1876 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368777099183/'
[junit4:junit4] 2> 729571 T1876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368777099183/'
[junit4:junit4] 2> 729689 T1876 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 729690 T1876 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 729690 T1876 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 729691 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 729691 T1876 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 729692 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 729692 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 729693 T1876 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 729693 T1876 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 729694 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 729709 T1876 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 729710 T1876 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50344/solr
[junit4:junit4] 2> 729711 T1876 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 729712 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 729715 T1916 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@677e2458 name:ZooKeeperConnection Watcher:127.0.0.1:50344 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 729716 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 729719 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 729731 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 729733 T1918 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6dc82ef0 name:ZooKeeperConnection Watcher:127.0.0.1:50344/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 729734 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 729745 T1876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 730750 T1876 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55332_nfucv%2Fim
[junit4:junit4] 2> 730776 T1876 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55332_nfucv%2Fim
[junit4:junit4] 2> 730786 T1905 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 730786 T1898 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 730786 T1918 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 730787 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 730801 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 730802 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47447_nfucv%2Fim_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47447_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47447/nfucv/im"}
[junit4:junit4] 2> 730807 T1919 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368777099183/collection1
[junit4:junit4] 2> 730807 T1919 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 730810 T1919 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 730810 T1919 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 730822 T1919 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368777099183/collection1/'
[junit4:junit4] 2> 730824 T1919 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368777099183/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 730824 T1919 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368777099183/collection1/lib/README' to classloader
[junit4:junit4] 2> 730831 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 730831 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 730834 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 730876 T1919 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 730937 T1919 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 731039 T1919 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 731045 T1919 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 731637 T1919 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 731641 T1919 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 731644 T1919 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 731649 T1919 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 731670 T1919 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 731671 T1919 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368777099183/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty1/
[junit4:junit4] 2> 731671 T1919 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1623a187
[junit4:junit4] 2> 731672 T1919 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 731672 T1919 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty1
[junit4:junit4] 2> 731673 T1919 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty1/index/
[junit4:junit4] 2> 731673 T1919 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 731674 T1919 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty1/index
[junit4:junit4] 2> 731677 T1919 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@512f3713 lockFactory=org.apache.lucene.store.NativeFSLockFactory@45f35b8b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 731677 T1919 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 731680 T1919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 731681 T1919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 731682 T1919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 731682 T1919 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 731683 T1919 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 731683 T1919 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 731684 T1919 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 731684 T1919 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 731685 T1919 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 731698 T1919 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 731704 T1919 oass.SolrIndexSearcher.<init> Opening Searcher@4429af90 main
[junit4:junit4] 2> 731705 T1919 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty1/tlog
[junit4:junit4] 2> 731706 T1919 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 731706 T1919 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 731711 T1920 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4429af90 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 731713 T1919 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 731713 T1919 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 732335 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 732336 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55332_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55332/nfucv/im"}
[junit4:junit4] 2> 732336 T1899 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 732337 T1899 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 732351 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 732351 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 732351 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 732741 T1919 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 732741 T1919 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55332/nfucv/im collection:collection1 shard:shard1
[junit4:junit4] 2> 732742 T1919 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 732769 T1919 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 732778 T1919 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 732778 T1919 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 732778 T1919 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55332/nfucv/im/collection1/
[junit4:junit4] 2> 732779 T1919 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 732779 T1919 oasc.SyncStrategy.syncToMe http://127.0.0.1:55332/nfucv/im/collection1/ has no replicas
[junit4:junit4] 2> 732779 T1919 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55332/nfucv/im/collection1/
[junit4:junit4] 2> 732780 T1919 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 733860 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 733877 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 733877 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 733877 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 733913 T1919 oasc.ZkController.register We are http://127.0.0.1:55332/nfucv/im/collection1/ and leader is http://127.0.0.1:55332/nfucv/im/collection1/
[junit4:junit4] 2> 733913 T1919 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55332/nfucv/im
[junit4:junit4] 2> 733913 T1919 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 733913 T1919 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 733914 T1919 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 733915 T1919 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 733916 T1876 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 733917 T1876 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 733918 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 734152 T1876 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 734156 T1876 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:14886
[junit4:junit4] 2> 734156 T1876 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 734157 T1876 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 734158 T1876 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368777103779
[junit4:junit4] 2> 734158 T1876 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368777103779/solr.xml
[junit4:junit4] 2> 734159 T1876 oasc.CoreContainer.<init> New CoreContainer 1503308584
[junit4:junit4] 2> 734159 T1876 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368777103779/'
[junit4:junit4] 2> 734160 T1876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368777103779/'
[junit4:junit4] 2> 734276 T1876 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 734277 T1876 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 734278 T1876 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 734278 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 734279 T1876 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 734279 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 734280 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 734280 T1876 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 734281 T1876 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 734281 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 734298 T1876 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 734299 T1876 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50344/solr
[junit4:junit4] 2> 734299 T1876 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 734300 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 734304 T1932 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32130939 name:ZooKeeperConnection Watcher:127.0.0.1:50344 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 734304 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 734319 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 734331 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 734334 T1934 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fe17257 name:ZooKeeperConnection Watcher:127.0.0.1:50344/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 734334 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 734344 T1876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 735347 T1876 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:14886_nfucv%2Fim
[junit4:junit4] 2> 735349 T1876 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:14886_nfucv%2Fim
[junit4:junit4] 2> 735352 T1898 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 735352 T1918 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 735352 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 735352 T1934 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 735352 T1905 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 735353 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 735353 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 735370 T1935 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368777103779/collection1
[junit4:junit4] 2> 735370 T1935 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 735371 T1935 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 735371 T1935 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 735373 T1935 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368777103779/collection1/'
[junit4:junit4] 2> 735374 T1935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368777103779/collection1/lib/README' to classloader
[junit4:junit4] 2> 735375 T1935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368777103779/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 735390 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 735391 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:55332_nfucv%2Fim_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55332_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55332/nfucv/im"}
[junit4:junit4] 2> 735401 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 735401 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 735401 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 735401 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 735431 T1935 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 735492 T1935 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 735593 T1935 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 735599 T1935 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 736192 T1935 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 736196 T1935 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 736198 T1935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 736204 T1935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 736226 T1935 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 736226 T1935 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368777103779/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty2/
[junit4:junit4] 2> 736226 T1935 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1623a187
[junit4:junit4] 2> 736227 T1935 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 736228 T1935 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty2
[junit4:junit4] 2> 736228 T1935 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty2/index/
[junit4:junit4] 2> 736228 T1935 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 736229 T1935 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty2/index
[junit4:junit4] 2> 736232 T1935 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43c99dc1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4413e0b3),segFN=segments_1,generation=1}
[junit4:junit4] 2> 736233 T1935 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 736236 T1935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 736236 T1935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 736237 T1935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 736238 T1935 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 736239 T1935 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 736239 T1935 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 736239 T1935 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 736240 T1935 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 736241 T1935 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 736253 T1935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 736259 T1935 oass.SolrIndexSearcher.<init> Opening Searcher@49b9c0b0 main
[junit4:junit4] 2> 736260 T1935 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty2/tlog
[junit4:junit4] 2> 736261 T1935 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 736261 T1935 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 736266 T1936 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49b9c0b0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 736269 T1935 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 736269 T1935 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 736905 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 736906 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14886_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14886/nfucv/im"}
[junit4:junit4] 2> 736907 T1899 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 736907 T1899 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 736911 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 736911 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 736911 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 736911 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 737277 T1935 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 737277 T1935 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:14886/nfucv/im collection:collection1 shard:shard2
[junit4:junit4] 2> 737278 T1935 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 737297 T1935 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 737305 T1935 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 737305 T1935 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 737306 T1935 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:14886/nfucv/im/collection1/
[junit4:junit4] 2> 737306 T1935 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 737306 T1935 oasc.SyncStrategy.syncToMe http://127.0.0.1:14886/nfucv/im/collection1/ has no replicas
[junit4:junit4] 2> 737307 T1935 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:14886/nfucv/im/collection1/
[junit4:junit4] 2> 737307 T1935 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 738414 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 738430 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 738430 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 738430 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 738430 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 738491 T1935 oasc.ZkController.register We are http://127.0.0.1:14886/nfucv/im/collection1/ and leader is http://127.0.0.1:14886/nfucv/im/collection1/
[junit4:junit4] 2> 738491 T1935 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:14886/nfucv/im
[junit4:junit4] 2> 738491 T1935 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 738491 T1935 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 738492 T1935 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 738493 T1935 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 738495 T1876 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 738495 T1876 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 738496 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 738726 T1876 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 738730 T1876 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45892
[junit4:junit4] 2> 738731 T1876 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 738732 T1876 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 738732 T1876 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368777108355
[junit4:junit4] 2> 738733 T1876 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368777108355/solr.xml
[junit4:junit4] 2> 738733 T1876 oasc.CoreContainer.<init> New CoreContainer 1037440195
[junit4:junit4] 2> 738734 T1876 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368777108355/'
[junit4:junit4] 2> 738734 T1876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368777108355/'
[junit4:junit4] 2> 738850 T1876 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 738851 T1876 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 738852 T1876 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 738852 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 738853 T1876 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 738853 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 738854 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 738854 T1876 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 738855 T1876 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 738855 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 738870 T1876 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 738871 T1876 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50344/solr
[junit4:junit4] 2> 738872 T1876 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 738873 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 738876 T1948 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43452b69 name:ZooKeeperConnection Watcher:127.0.0.1:50344 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 738877 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 738892 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 738903 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 738905 T1950 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70aa790b name:ZooKeeperConnection Watcher:127.0.0.1:50344/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 738906 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 738910 T1876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 739914 T1876 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45892_nfucv%2Fim
[junit4:junit4] 2> 739916 T1876 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45892_nfucv%2Fim
[junit4:junit4] 2> 739919 T1918 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 739919 T1898 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 739919 T1950 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 739919 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 739919 T1934 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 739919 T1905 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 739920 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 739919 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 739920 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 739940 T1951 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368777108355/collection1
[junit4:junit4] 2> 739941 T1951 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 739941 T1951 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 739941 T1951 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 739943 T1951 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368777108355/collection1/'
[junit4:junit4] 2> 739944 T1951 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368777108355/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 739945 T1951 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368777108355/collection1/lib/README' to classloader
[junit4:junit4] 2> 739949 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 739949 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:14886_nfucv%2Fim_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14886_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14886/nfucv/im"}
[junit4:junit4] 2> 739959 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 739960 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 739960 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 739959 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 739959 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 739996 T1951 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 740056 T1951 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 740157 T1951 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 740162 T1951 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 740755 T1951 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 740759 T1951 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 740761 T1951 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 740766 T1951 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 740789 T1951 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 740790 T1951 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368777108355/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3/
[junit4:junit4] 2> 740790 T1951 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1623a187
[junit4:junit4] 2> 740791 T1951 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 740792 T1951 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3
[junit4:junit4] 2> 740792 T1951 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3/index/
[junit4:junit4] 2> 740792 T1951 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 740793 T1951 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3/index
[junit4:junit4] 2> 740796 T1951 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1bb9b89c lockFactory=org.apache.lucene.store.NativeFSLockFactory@54ed5fa7),segFN=segments_1,generation=1}
[junit4:junit4] 2> 740796 T1951 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 740799 T1951 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 740800 T1951 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 740800 T1951 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 740801 T1951 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 740802 T1951 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 740802 T1951 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 740802 T1951 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 740803 T1951 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 740803 T1951 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 740816 T1951 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 740821 T1951 oass.SolrIndexSearcher.<init> Opening Searcher@56f77ca4 main
[junit4:junit4] 2> 740822 T1951 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3/tlog
[junit4:junit4] 2> 740823 T1951 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 740823 T1951 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 740827 T1952 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56f77ca4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 740830 T1951 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 740830 T1951 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 741464 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 741465 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45892_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45892/nfucv/im"}
[junit4:junit4] 2> 741465 T1899 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 741466 T1899 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 741470 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 741470 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 741470 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 741470 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 741470 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 741833 T1951 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 741833 T1951 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45892/nfucv/im collection:collection1 shard:shard1
[junit4:junit4] 2> 741836 T1951 oasc.ZkController.register We are http://127.0.0.1:45892/nfucv/im/collection1/ and leader is http://127.0.0.1:55332/nfucv/im/collection1/
[junit4:junit4] 2> 741837 T1951 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45892/nfucv/im
[junit4:junit4] 2> 741837 T1951 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 741837 T1951 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C72 name=collection1 org.apache.solr.core.SolrCore@3a5b028e url=http://127.0.0.1:45892/nfucv/im/collection1 node=127.0.0.1:45892_nfucv%2Fim C72_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:45892_nfucv%2Fim, base_url=http://127.0.0.1:45892/nfucv/im}
[junit4:junit4] 2> 741838 T1953 C72 P45892 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 741838 T1951 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 741839 T1953 C72 P45892 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 741840 T1953 C72 P45892 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 741840 T1953 C72 P45892 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 741841 T1876 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 741841 T1876 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 741842 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 741910 T1953 C72 P45892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 741922 T1908 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:45892_nfucv%2Fim_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 742081 T1876 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 742084 T1876 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:26404
[junit4:junit4] 2> 742085 T1876 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 742086 T1876 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 742086 T1876 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368777111701
[junit4:junit4] 2> 742087 T1876 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368777111701/solr.xml
[junit4:junit4] 2> 742087 T1876 oasc.CoreContainer.<init> New CoreContainer 593303825
[junit4:junit4] 2> 742088 T1876 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368777111701/'
[junit4:junit4] 2> 742089 T1876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368777111701/'
[junit4:junit4] 2> 742206 T1876 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 742207 T1876 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 742208 T1876 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 742208 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 742209 T1876 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 742209 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 742210 T1876 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 742210 T1876 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 742211 T1876 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 742211 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 742227 T1876 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 742227 T1876 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50344/solr
[junit4:junit4] 2> 742228 T1876 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 742229 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 742232 T1965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eed0d80 name:ZooKeeperConnection Watcher:127.0.0.1:50344 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 742233 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 742235 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 742246 T1876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 742272 T1967 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51a038c7 name:ZooKeeperConnection Watcher:127.0.0.1:50344/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 742272 T1876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 742277 T1876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 742986 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 742987 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:45892_nfucv%2Fim_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45892_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45892/nfucv/im"}
[junit4:junit4] 2> 743001 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 743001 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 743001 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 743001 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 743001 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 743001 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 743280 T1876 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:26404_nfucv%2Fim
[junit4:junit4] 2> 743282 T1876 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:26404_nfucv%2Fim
[junit4:junit4] 2> 743284 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 743285 T1898 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 743285 T1967 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 743285 T1934 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 743285 T1918 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 743285 T1905 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 743286 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 743286 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 743285 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 743285 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 743286 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 743286 T1950 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 743299 T1968 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368777111701/collection1
[junit4:junit4] 2> 743299 T1968 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 743300 T1968 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 743300 T1968 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 743301 T1968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368777111701/collection1/'
[junit4:junit4] 2> 743303 T1968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368777111701/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 743303 T1968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368777111701/collection1/lib/README' to classloader
[junit4:junit4] 2> 743354 T1968 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 743414 T1968 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 743515 T1968 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 743520 T1968 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 743925 T1908 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:45892_nfucv%2Fim_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 743925 T1908 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:45892_nfucv%252Fim_collection1&state=recovering&nodeName=127.0.0.1:45892_nfucv%252Fim&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 744093 T1968 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 744115 T1968 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 744118 T1968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 744123 T1968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 744145 T1968 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 744145 T1968 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368777111701/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/
[junit4:junit4] 2> 744146 T1968 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1623a187
[junit4:junit4] 2> 744146 T1968 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 744147 T1968 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4
[junit4:junit4] 2> 744147 T1968 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index/
[junit4:junit4] 2> 744148 T1968 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 744149 T1968 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index
[junit4:junit4] 2> 744152 T1968 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3a47edba lockFactory=org.apache.lucene.store.NativeFSLockFactory@16b10e7f),segFN=segments_1,generation=1}
[junit4:junit4] 2> 744152 T1968 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 744155 T1968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 744156 T1968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 744157 T1968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 744157 T1968 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 744158 T1968 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 744158 T1968 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 744159 T1968 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 744159 T1968 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 744160 T1968 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 744173 T1968 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 744179 T1968 oass.SolrIndexSearcher.<init> Opening Searcher@53755312 main
[junit4:junit4] 2> 744179 T1968 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/tlog
[junit4:junit4] 2> 744180 T1968 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 744181 T1968 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 744186 T1969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@53755312 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 744188 T1968 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 744188 T1968 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 744506 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 744507 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:26404_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:26404/nfucv/im"}
[junit4:junit4] 2> 744507 T1899 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 744507 T1899 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 744521 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 744521 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 744521 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 744521 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 744521 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 744521 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 745192 T1968 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 745192 T1968 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:26404/nfucv/im collection:collection1 shard:shard2
[junit4:junit4] 2> 745249 T1968 oasc.ZkController.register We are http://127.0.0.1:26404/nfucv/im/collection1/ and leader is http://127.0.0.1:14886/nfucv/im/collection1/
[junit4:junit4] 2> 745249 T1968 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:26404/nfucv/im
[junit4:junit4] 2> 745249 T1968 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 745249 T1968 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C73 name=collection1 org.apache.solr.core.SolrCore@11201270 url=http://127.0.0.1:26404/nfucv/im/collection1 node=127.0.0.1:26404_nfucv%2Fim C73_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:26404_nfucv%2Fim, base_url=http://127.0.0.1:26404/nfucv/im}
[junit4:junit4] 2> 745250 T1970 C73 P26404 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 745250 T1968 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 745251 T1970 C73 P26404 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 745252 T1970 C73 P26404 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 745252 T1970 C73 P26404 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 745252 T1876 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 745253 T1876 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 745253 T1970 C73 P26404 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 745254 T1876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 745276 T1876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 745277 T1924 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:26404_nfucv%2Fim_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 745277 T1876 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 745278 T1876 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 745279 T1876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C72_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:45892_nfucv%2Fim, base_url=http://127.0.0.1:45892/nfucv/im}
[junit4:junit4] 2> 745927 T1953 C72 P45892 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55332/nfucv/im/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 745927 T1953 C72 P45892 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:45892/nfucv/im START replicas=[http://127.0.0.1:55332/nfucv/im/collection1/] nUpdates=100
[junit4:junit4] 2> 745927 T1953 C72 P45892 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 745928 T1953 C72 P45892 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 745929 T1953 C72 P45892 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 745929 T1953 C72 P45892 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 745929 T1953 C72 P45892 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 745929 T1953 C72 P45892 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55332/nfucv/im/collection1/. core=collection1
[junit4:junit4] 2> 745930 T1953 C72 P45892 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C74 name=collection1 org.apache.solr.core.SolrCore@7d25a980 url=http://127.0.0.1:55332/nfucv/im/collection1 node=127.0.0.1:55332_nfucv%2Fim C74_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:55332_nfucv%2Fim, base_url=http://127.0.0.1:55332/nfucv/im, leader=true}
[junit4:junit4] 2> 745936 T1909 C74 P55332 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 745942 T1910 C74 P55332 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 745945 T1910 C74 P55332 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@512f3713 lockFactory=org.apache.lucene.store.NativeFSLockFactory@45f35b8b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 745945 T1910 C74 P55332 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 745946 T1910 C74 P55332 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@512f3713 lockFactory=org.apache.lucene.store.NativeFSLockFactory@45f35b8b),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@512f3713 lockFactory=org.apache.lucene.store.NativeFSLockFactory@45f35b8b),segFN=segments_2,generation=2}
[junit4:junit4] 2> 745947 T1910 C74 P55332 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 745947 T1910 C74 P55332 oass.SolrIndexSearcher.<init> Opening Searcher@4f05e32e realtime
[junit4:junit4] 2> 745948 T1910 C74 P55332 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 745948 T1910 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 745949 T1953 C72 P45892 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 745949 T1953 C72 P45892 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 745952 T1911 C74 P55332 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 745952 T1911 C74 P55332 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 745953 T1953 C72 P45892 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 745953 T1953 C72 P45892 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 745954 T1953 C72 P45892 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 745956 T1911 C74 P55332 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 745957 T1953 C72 P45892 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 745958 T1953 C72 P45892 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3/index.20130517052155801
[junit4:junit4] 2> 745959 T1953 C72 P45892 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1197fe08 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d86f25d) fullCopy=false
[junit4:junit4] 2> 745961 T1911 C74 P55332 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 745963 T1953 C72 P45892 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 745964 T1953 C72 P45892 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 745964 T1953 C72 P45892 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 745966 T1953 C72 P45892 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1bb9b89c lockFactory=org.apache.lucene.store.NativeFSLockFactory@54ed5fa7),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1bb9b89c lockFactory=org.apache.lucene.store.NativeFSLockFactory@54ed5fa7),segFN=segments_2,generation=2}
[junit4:junit4] 2> 745966 T1953 C72 P45892 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 745967 T1953 C72 P45892 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 745967 T1953 C72 P45892 oass.SolrIndexSearcher.<init> Opening Searcher@529a92b5 main
[junit4:junit4] 2> 745968 T1952 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@529a92b5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 745969 T1953 C72 P45892 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3/index.20130517052155801 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3/index.20130517052155801;done=true>>]
[junit4:junit4] 2> 745969 T1953 C72 P45892 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3/index.20130517052155801
[junit4:junit4] 2> 745969 T1953 C72 P45892 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty3/index.20130517052155801
[junit4:junit4] 2> 745970 T1953 C72 P45892 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 745970 T1953 C72 P45892 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 745970 T1953 C72 P45892 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 745970 T1953 C72 P45892 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 745972 T1953 C72 P45892 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 746025 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 746026 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:26404_nfucv%2Fim_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:26404_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:26404/nfucv/im"}
[junit4:junit4] 2> 746029 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:45892_nfucv%2Fim_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45892_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45892/nfucv/im"}
[junit4:junit4] 2> 746041 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 746041 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 746041 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 746041 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 746041 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 746041 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 746279 T1924 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:26404_nfucv%2Fim_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 746279 T1924 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:26404_nfucv%252Fim_collection1&state=recovering&nodeName=127.0.0.1:26404_nfucv%252Fim&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 746281 T1876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 747283 T1876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C73_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:26404_nfucv%2Fim, base_url=http://127.0.0.1:26404/nfucv/im}
[junit4:junit4] 2> 748281 T1970 C73 P26404 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:14886/nfucv/im/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 748281 T1970 C73 P26404 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:26404/nfucv/im START replicas=[http://127.0.0.1:14886/nfucv/im/collection1/] nUpdates=100
[junit4:junit4] 2> 748282 T1970 C73 P26404 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 748282 T1970 C73 P26404 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 748282 T1970 C73 P26404 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 748282 T1970 C73 P26404 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 748282 T1970 C73 P26404 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 748283 T1970 C73 P26404 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:14886/nfucv/im/collection1/. core=collection1
[junit4:junit4] 2> 748283 T1970 C73 P26404 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 748286 T1876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C75 name=collection1 org.apache.solr.core.SolrCore@6007d7f url=http://127.0.0.1:14886/nfucv/im/collection1 node=127.0.0.1:14886_nfucv%2Fim C75_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:14886_nfucv%2Fim, base_url=http://127.0.0.1:14886/nfucv/im, leader=true}
[junit4:junit4] 2> 748291 T1925 C75 P14886 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 748296 T1926 C75 P14886 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 748298 T1926 C75 P14886 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43c99dc1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4413e0b3),segFN=segments_1,generation=1}
[junit4:junit4] 2> 748299 T1926 C75 P14886 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 748300 T1926 C75 P14886 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43c99dc1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4413e0b3),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43c99dc1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4413e0b3),segFN=segments_2,generation=2}
[junit4:junit4] 2> 748300 T1926 C75 P14886 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 748301 T1926 C75 P14886 oass.SolrIndexSearcher.<init> Opening Searcher@22ab08b1 realtime
[junit4:junit4] 2> 748301 T1926 C75 P14886 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 748302 T1926 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 748303 T1970 C73 P26404 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 748303 T1970 C73 P26404 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 748305 T1927 C75 P14886 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 748305 T1927 C75 P14886 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 748306 T1970 C73 P26404 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 748306 T1970 C73 P26404 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 748306 T1970 C73 P26404 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 748309 T1927 C75 P14886 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 748310 T1970 C73 P26404 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 748311 T1970 C73 P26404 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index.20130517052158155
[junit4:junit4] 2> 748312 T1970 C73 P26404 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@7238091e lockFactory=org.apache.lucene.store.NativeFSLockFactory@125fcf9f) fullCopy=false
[junit4:junit4] 2> 748314 T1927 C75 P14886 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 748315 T1970 C73 P26404 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 748316 T1970 C73 P26404 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 748317 T1970 C73 P26404 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 748318 T1970 C73 P26404 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3a47edba lockFactory=org.apache.lucene.store.NativeFSLockFactory@16b10e7f),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3a47edba lockFactory=org.apache.lucene.store.NativeFSLockFactory@16b10e7f),segFN=segments_2,generation=2}
[junit4:junit4] 2> 748319 T1970 C73 P26404 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 748319 T1970 C73 P26404 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 748320 T1970 C73 P26404 oass.SolrIndexSearcher.<init> Opening Searcher@4a72515f main
[junit4:junit4] 2> 748321 T1969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4a72515f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 748321 T1970 C73 P26404 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index.20130517052158155 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index.20130517052158155;done=true>>]
[junit4:junit4] 2> 748322 T1970 C73 P26404 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index.20130517052158155
[junit4:junit4] 2> 748322 T1970 C73 P26404 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index.20130517052158155
[junit4:junit4] 2> 748322 T1970 C73 P26404 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 748322 T1970 C73 P26404 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 748323 T1970 C73 P26404 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 748323 T1970 C73 P26404 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 748324 T1970 C73 P26404 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 749055 T1899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 749056 T1899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:26404_nfucv%2Fim_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:26404_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:26404/nfucv/im"}
[junit4:junit4] 2> 749071 T1898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 749071 T1950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 749071 T1905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 749071 T1918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 749071 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 749071 T1934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 749288 T1876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 749289 T1876 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C76 name=collection1 org.apache.solr.core.SolrCore@496efeed url=http://127.0.0.1:47447/nfucv/im/collection1 node=127.0.0.1:47447_nfucv%2Fim C76_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:47447_nfucv%2Fim, base_url=http://127.0.0.1:47447/nfucv/im, leader=true}
[junit4:junit4] 2> 749298 T1888 C76 P47447 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 749302 T1888 C76 P47447 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@596f31a3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63b35223),segFN=segments_1,generation=1}
[junit4:junit4] 2> 749303 T1888 C76 P47447 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 749304 T1888 C76 P47447 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@596f31a3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63b35223),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@596f31a3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63b35223),segFN=segments_2,generation=2}
[junit4:junit4] 2> 749304 T1888 C76 P47447 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 749305 T1888 C76 P47447 oass.SolrIndexSearcher.<init> Opening Searcher@572efdc0 main
[junit4:junit4] 2> 749305 T1888 C76 P47447 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 749306 T1902 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@572efdc0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 749307 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 749319 T1928 C75 P14886 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 749320 T1928 C75 P14886 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43c99dc1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4413e0b3),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43c99dc1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4413e0b3),segFN=segments_3,generation=3}
[junit4:junit4] 2> 749321 T1928 C75 P14886 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 749321 T1928 C75 P14886 oass.SolrIndexSearcher.<init> Opening Searcher@a5bdf24 main
[junit4:junit4] 2> 749322 T1928 C75 P14886 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 749322 T1936 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a5bdf24 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 749323 T1928 C75 P14886 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:55332/nfucv/im/collection1/, StdNode: http://127.0.0.1:45892/nfucv/im/collection1/, StdNode: http://127.0.0.1:26404/nfucv/im/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 749326 T1912 C74 P55332 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 749328 T1912 C74 P55332 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@512f3713 lockFactory=org.apache.lucene.store.NativeFSLockFactory@45f35b8b),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@512f3713 lockFactory=org.apache.lucene.store.NativeFSLockFactory@45f35b8b),segFN=segments_3,generation=3}
[junit4:junit4] 2> 749328 T1912 C74 P55332 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 749329 T1912 C74 P55332 oass.SolrIndexSearcher.<init> Opening Searcher@42c85801 main
[junit4:junit4] 2> 749329 T1912 C74 P55332 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 749331 T1920 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@42c85801 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 749331 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C73_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:26404_nfucv%2Fim, base_url=http://127.0.0.1:26404/nfucv/im}
[junit4:junit4] 2> 749334 T1957 C73 P26404 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C72_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:45892_nfucv%2Fim, base_url=http://127.0.0.1:45892/nfucv/im}
[junit4:junit4] 2> 749336 T1940 C72 P45892 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 749337 T1957 C73 P26404 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3a47edba lockFactory=org.apache.lucene.store.NativeFSLockFactory@16b10e7f),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3a47edba lockFactory=org.apache.lucene.store.NativeFSLockFactory@16b10e7f),segFN=segments_3,generation=3}
[junit4:junit4] 2> 749337 T1940 C72 P45892 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1bb9b89c lockFactory=org.apache.lucene.store.NativeFSLockFactory@54ed5fa7),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1bb9b89c lockFactory=org.apache.lucene.store.NativeFSLockFactory@54ed5fa7),segFN=segments_3,generation=3}
[junit4:junit4] 2> 749337 T1957 C73 P26404 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 749338 T1940 C72 P45892 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 749339 T1957 C73 P26404 oass.SolrIndexSearcher.<init> Opening Searcher@7ee19a64 main
[junit4:junit4] 2> 749339 T1940 C72 P45892 oass.SolrIndexSearcher.<init> Opening Searcher@5e525470 main
[junit4:junit4] 2> 749340 T1957 C73 P26404 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 749340 T1969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ee19a64 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 749340 T1940 C72 P45892 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 749341 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 749341 T1952 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5e525470 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 749342 T1940 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 749343 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4] 2> 749344 T1876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 749347 T1913 C74 P55332 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 749349 T1941 C72 P45892 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 749351 T1929 C75 P14886 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 749353 T1958 C73 P26404 oasc.SolrCore.execute [collection1] webapp=/nfucv/im path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 751359 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435266838641508352)} 0 2
[junit4:junit4] 2> 751368 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={update.distrib=FROMLEADER&_version_=-1435266838645702656&update.from=http://127.0.0.1:55332/nfucv/im/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435266838645702656)} 0 2
[junit4:junit4] 2> 751371 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={update.distrib=FROMLEADER&_version_=-1435266838649896960&update.from=http://127.0.0.1:14886/nfucv/im/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435266838649896960)} 0 1
[junit4:junit4] 2> 751372 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435266838649896960)} 0 6
[junit4:junit4] 2> 751373 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435266838645702656)} 0 11
[junit4:junit4] 2> 751377 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[0 (1435266838660382720)]} 0 1
[junit4:junit4] 2> 751384 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435266838664577024)]} 0 1
[junit4:junit4] 2> 751384 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[0 (1435266838664577024)]} 0 4
[junit4:junit4] 2> 751388 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[1 (1435266838671917056)]} 0 1
[junit4:junit4] 2> 751394 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435266838675062784)]} 0 1
[junit4:junit4] 2> 751394 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[1 (1435266838675062784)]} 0 4
[junit4:junit4] 2> 751398 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[2 (1435266838682402816)]} 0 1
[junit4:junit4] 2> 751407 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435266838688694272)]} 0 1
[junit4:junit4] 2> 751407 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1435266838688694272)]} 0 4
[junit4:junit4] 2> 751408 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[2]} 0 8
[junit4:junit4] 2> 751412 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[3 (1435266838697082880)]} 0 1
[junit4:junit4] 2> 751421 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435266838703374336)]} 0 1
[junit4:junit4] 2> 751421 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1435266838703374336)]} 0 4
[junit4:junit4] 2> 751422 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[3]} 0 8
[junit4:junit4] 2> 751425 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[4 (1435266838711762944)]} 0 0
[junit4:junit4] 2> 751435 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435266838718054400)]} 0 1
[junit4:junit4] 2> 751435 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1435266838718054400)]} 0 4
[junit4:junit4] 2> 751436 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[4]} 0 8
[junit4:junit4] 2> 751440 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[5 (1435266838726443008)]} 0 1
[junit4:junit4] 2> 751446 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435266838729588736)]} 0 1
[junit4:junit4] 2> 751446 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[5 (1435266838729588736)]} 0 4
[junit4:junit4] 2> 751450 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[6 (1435266838736928768)]} 0 1
[junit4:junit4] 2> 751459 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435266838743220224)]} 0 1
[junit4:junit4] 2> 751459 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1435266838743220224)]} 0 4
[junit4:junit4] 2> 751460 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[6]} 0 8
[junit4:junit4] 2> 751464 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[7 (1435266838751608832)]} 0 1
[junit4:junit4] 2> 751473 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435266838757900288)]} 0 1
[junit4:junit4] 2> 751473 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1435266838757900288)]} 0 4
[junit4:junit4] 2> 751474 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[7]} 0 8
[junit4:junit4] 2> 751478 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[8 (1435266838766288896)]} 0 1
[junit4:junit4] 2> 751487 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435266838772580352)]} 0 1
[junit4:junit4] 2> 751487 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1435266838772580352)]} 0 4
[junit4:junit4] 2> 751488 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[8]} 0 8
[junit4:junit4] 2> 751492 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[9 (1435266838780968960)]} 0 1
[junit4:junit4] 2> 751498 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435266838784114688)]} 0 1
[junit4:junit4] 2> 751498 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[9 (1435266838784114688)]} 0 4
[junit4:junit4] 2> 751502 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[10 (1435266838791454720)]} 0 1
[junit4:junit4] 2> 751508 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435266838794600448)]} 0 1
[junit4:junit4] 2> 751508 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[10 (1435266838794600448)]} 0 4
[junit4:junit4] 2> 751512 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[11 (1435266838801940480)]} 0 1
[junit4:junit4] 2> 751518 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435266838805086208)]} 0 1
[junit4:junit4] 2> 751518 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[11 (1435266838805086208)]} 0 4
[junit4:junit4] 2> 751522 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[12 (1435266838812426240)]} 0 1
[junit4:junit4] 2> 751530 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435266838817669120)]} 0 1
[junit4:junit4] 2> 751530 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[12 (1435266838817669120)]} 0 4
[junit4:junit4] 2> 751531 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[12]} 0 7
[junit4:junit4] 2> 751535 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[13 (1435266838826057728)]} 0 0
[junit4:junit4] 2> 751541 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435266838829203456)]} 0 1
[junit4:junit4] 2> 751541 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[13 (1435266838829203456)]} 0 4
[junit4:junit4] 2> 751544 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[14 (1435266838836543488)]} 0 0
[junit4:junit4] 2> 751551 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435266838839689216)]} 0 1
[junit4:junit4] 2> 751551 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[14 (1435266838839689216)]} 0 4
[junit4:junit4] 2> 751555 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[15 (1435266838847029248)]} 0 1
[junit4:junit4] 2> 751561 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435266838850174976)]} 0 1
[junit4:junit4] 2> 751561 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[15 (1435266838850174976)]} 0 4
[junit4:junit4] 2> 751565 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[16 (1435266838857515008)]} 0 1
[junit4:junit4] 2> 751571 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435266838860660736)]} 0 1
[junit4:junit4] 2> 751571 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[16 (1435266838860660736)]} 0 4
[junit4:junit4] 2> 751575 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[17 (1435266838868000768)]} 0 1
[junit4:junit4] 2> 751581 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435266838871146496)]} 0 1
[junit4:junit4] 2> 751581 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[17 (1435266838871146496)]} 0 4
[junit4:junit4] 2> 751585 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[18 (1435266838878486528)]} 0 1
[junit4:junit4] 2> 751591 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435266838881632256)]} 0 1
[junit4:junit4] 2> 751591 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[18 (1435266838881632256)]} 0 4
[junit4:junit4] 2> 751595 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[19 (1435266838888972288)]} 0 1
[junit4:junit4] 2> 751603 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435266838894215168)]} 0 1
[junit4:junit4] 2> 751603 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[19 (1435266838894215168)]} 0 4
[junit4:junit4] 2> 751604 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[19]} 0 7
[junit4:junit4] 2> 751608 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[20 (1435266838902603776)]} 0 1
[junit4:junit4] 2> 751617 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435266838908895232)]} 0 1
[junit4:junit4] 2> 751617 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[20 (1435266838908895232)]} 0 4
[junit4:junit4] 2> 751618 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[20]} 0 8
[junit4:junit4] 2> 751622 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[21 (1435266838917283840)]} 0 1
[junit4:junit4] 2> 751631 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435266838923575296)]} 0 1
[junit4:junit4] 2> 751631 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[21 (1435266838923575296)]} 0 4
[junit4:junit4] 2> 751632 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[21]} 0 8
[junit4:junit4] 2> 751636 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[22 (1435266838931963904)]} 0 1
[junit4:junit4] 2> 751645 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435266838938255360)]} 0 1
[junit4:junit4] 2> 751645 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1435266838938255360)]} 0 4
[junit4:junit4] 2> 751646 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[22]} 0 8
[junit4:junit4] 2> 751650 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[23 (1435266838946643968)]} 0 1
[junit4:junit4] 2> 751656 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435266838949789696)]} 0 1
[junit4:junit4] 2> 751656 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[23 (1435266838949789696)]} 0 4
[junit4:junit4] 2> 751659 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[24 (1435266838957129728)]} 0 0
[junit4:junit4] 2> 751666 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435266838960275456)]} 0 1
[junit4:junit4] 2> 751666 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[24 (1435266838960275456)]} 0 4
[junit4:junit4] 2> 751670 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[25 (1435266838967615488)]} 0 1
[junit4:junit4] 2> 751676 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435266838970761216)]} 0 1
[junit4:junit4] 2> 751676 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[25 (1435266838970761216)]} 0 4
[junit4:junit4] 2> 751680 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[26 (1435266838978101248)]} 0 1
[junit4:junit4] 2> 751689 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435266838984392704)]} 0 1
[junit4:junit4] 2> 751689 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1435266838984392704)]} 0 4
[junit4:junit4] 2> 751690 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[26]} 0 8
[junit4:junit4] 2> 751694 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[27 (1435266838992781312)]} 0 1
[junit4:junit4] 2> 751703 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435266838999072768)]} 0 1
[junit4:junit4] 2> 751703 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[27 (1435266838999072768)]} 0 4
[junit4:junit4] 2> 751704 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[27]} 0 8
[junit4:junit4] 2> 751708 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[28 (1435266839007461376)]} 0 1
[junit4:junit4] 2> 751714 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435266839010607104)]} 0 1
[junit4:junit4] 2> 751714 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[28 (1435266839010607104)]} 0 4
[junit4:junit4] 2> 751718 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[29 (1435266839017947136)]} 0 1
[junit4:junit4] 2> 751724 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435266839021092864)]} 0 1
[junit4:junit4] 2> 751724 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[29 (1435266839021092864)]} 0 4
[junit4:junit4] 2> 751728 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[30 (1435266839028432896)]} 0 1
[junit4:junit4] 2> 751734 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435266839031578624)]} 0 1
[junit4:junit4] 2> 751734 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[30 (1435266839031578624)]} 0 4
[junit4:junit4] 2> 751738 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[31 (1435266839038918656)]} 0 1
[junit4:junit4] 2> 751744 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435266839042064384)]} 0 1
[junit4:junit4] 2> 751744 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[31 (1435266839042064384)]} 0 4
[junit4:junit4] 2> 751748 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[32 (1435266839049404416)]} 0 1
[junit4:junit4] 2> 751757 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435266839055695872)]} 0 1
[junit4:junit4] 2> 751757 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[32 (1435266839055695872)]} 0 4
[junit4:junit4] 2> 751758 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[32]} 0 8
[junit4:junit4] 2> 751762 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[33 (1435266839064084480)]} 0 1
[junit4:junit4] 2> 751768 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435266839067230208)]} 0 1
[junit4:junit4] 2> 751768 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[33 (1435266839067230208)]} 0 4
[junit4:junit4] 2> 751772 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[34 (1435266839074570240)]} 0 1
[junit4:junit4] 2> 751778 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1435266839077715968)]} 0 1
[junit4:junit4] 2> 751778 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[34 (1435266839077715968)]} 0 4
[junit4:junit4] 2> 751782 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[35 (1435266839085056000)]} 0 1
[junit4:junit4] 2> 751788 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1435266839088201728)]} 0 1
[junit4:junit4] 2> 751788 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[35 (1435266839088201728)]} 0 4
[junit4:junit4] 2> 751792 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[36 (1435266839095541760)]} 0 1
[junit4:junit4] 2> 751798 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1435266839098687488)]} 0 1
[junit4:junit4] 2> 751798 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[36 (1435266839098687488)]} 0 4
[junit4:junit4] 2> 751802 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[37 (1435266839106027520)]} 0 1
[junit4:junit4] 2> 751811 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1435266839112318976)]} 0 1
[junit4:junit4] 2> 751811 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[37 (1435266839112318976)]} 0 4
[junit4:junit4] 2> 751812 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[37]} 0 8
[junit4:junit4] 2> 751816 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[38 (1435266839120707584)]} 0 1
[junit4:junit4] 2> 751822 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1435266839123853312)]} 0 1
[junit4:junit4] 2> 751822 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[38 (1435266839123853312)]} 0 4
[junit4:junit4] 2> 751826 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[39 (1435266839131193344)]} 0 1
[junit4:junit4] 2> 751832 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1435266839134339072)]} 0 1
[junit4:junit4] 2> 751832 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[39 (1435266839134339072)]} 0 4
[junit4:junit4] 2> 751836 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[40 (1435266839141679104)]} 0 1
[junit4:junit4] 2> 751845 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1435266839147970560)]} 0 1
[junit4:junit4] 2> 751845 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[40 (1435266839147970560)]} 0 4
[junit4:junit4] 2> 751846 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[40]} 0 8
[junit4:junit4] 2> 751850 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[41 (1435266839156359168)]} 0 1
[junit4:junit4] 2> 751856 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1435266839159504896)]} 0 1
[junit4:junit4] 2> 751856 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[41 (1435266839159504896)]} 0 4
[junit4:junit4] 2> 751860 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[42 (1435266839166844928)]} 0 1
[junit4:junit4] 2> 751869 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1435266839173136384)]} 0 1
[junit4:junit4] 2> 751869 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[42 (1435266839173136384)]} 0 4
[junit4:junit4] 2> 751870 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[42]} 0 8
[junit4:junit4] 2> 751874 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[43 (1435266839181524992)]} 0 1
[junit4:junit4] 2> 751883 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1435266839187816448)]} 0 1
[junit4:junit4] 2> 751883 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[43 (1435266839187816448)]} 0 4
[junit4:junit4] 2> 751884 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[43]} 0 8
[junit4:junit4] 2> 751888 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[44 (1435266839196205056)]} 0 1
[junit4:junit4] 2> 751894 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1435266839199350784)]} 0 1
[junit4:junit4] 2> 751894 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[44 (1435266839199350784)]} 0 4
[junit4:junit4] 2> 751898 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[45 (1435266839206690816)]} 0 1
[junit4:junit4] 2> 751904 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1435266839209836544)]} 0 1
[junit4:junit4] 2> 751904 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[45 (1435266839209836544)]} 0 4
[junit4:junit4] 2> 751908 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[46 (1435266839217176576)]} 0 1
[junit4:junit4] 2> 751914 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1435266839220322304)]} 0 1
[junit4:junit4] 2> 751914 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[46 (1435266839220322304)]} 0 4
[junit4:junit4] 2> 751918 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[47 (1435266839227662336)]} 0 1
[junit4:junit4] 2> 751924 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1435266839230808064)]} 0 1
[junit4:junit4] 2> 751924 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[47 (1435266839230808064)]} 0 4
[junit4:junit4] 2> 751928 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[48 (1435266839238148096)]} 0 1
[junit4:junit4] 2> 751936 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1435266839243390976)]} 0 1
[junit4:junit4] 2> 751936 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[48 (1435266839243390976)]} 0 4
[junit4:junit4] 2> 751937 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[48]} 0 7
[junit4:junit4] 2> 751941 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[49 (1435266839251779584)]} 0 1
[junit4:junit4] 2> 751950 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1435266839258071040)]} 0 1
[junit4:junit4] 2> 751950 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[49 (1435266839258071040)]} 0 4
[junit4:junit4] 2> 751951 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[49]} 0 8
[junit4:junit4] 2> 751955 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[50 (1435266839267508224)]} 0 1
[junit4:junit4] 2> 751963 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1435266839271702528)]} 0 1
[junit4:junit4] 2> 751963 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[50 (1435266839271702528)]} 0 4
[junit4:junit4] 2> 751967 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[51 (1435266839279042560)]} 0 1
[junit4:junit4] 2> 751973 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1435266839282188288)]} 0 1
[junit4:junit4] 2> 751973 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[51 (1435266839282188288)]} 0 4
[junit4:junit4] 2> 751977 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[52 (1435266839289528320)]} 0 1
[junit4:junit4] 2> 751986 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1435266839295819776)]} 0 1
[junit4:junit4] 2> 751986 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[52 (1435266839295819776)]} 0 4
[junit4:junit4] 2> 751987 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[52]} 0 8
[junit4:junit4] 2> 751991 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[53 (1435266839304208384)]} 0 1
[junit4:junit4] 2> 752000 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1435266839310499840)]} 0 1
[junit4:junit4] 2> 752000 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1435266839310499840)]} 0 4
[junit4:junit4] 2> 752001 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[53]} 0 8
[junit4:junit4] 2> 752004 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[54 (1435266839318888448)]} 0 0
[junit4:junit4] 2> 752011 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1435266839322034176)]} 0 1
[junit4:junit4] 2> 752011 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[54 (1435266839322034176)]} 0 4
[junit4:junit4] 2> 752015 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[55 (1435266839329374208)]} 0 1
[junit4:junit4] 2> 752022 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1435266839333568512)]} 0 1
[junit4:junit4] 2> 752022 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[55 (1435266839333568512)]} 0 4
[junit4:junit4] 2> 752026 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[56 (1435266839340908544)]} 0 1
[junit4:junit4] 2> 752032 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1435266839344054272)]} 0 1
[junit4:junit4] 2> 752032 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[56 (1435266839344054272)]} 0 4
[junit4:junit4] 2> 752036 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[57 (1435266839351394304)]} 0 1
[junit4:junit4] 2> 752043 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1435266839355588608)]} 0 1
[junit4:junit4] 2> 752043 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[57 (1435266839355588608)]} 0 4
[junit4:junit4] 2> 752047 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[58 (1435266839362928640)]} 0 1
[junit4:junit4] 2> 752056 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1435266839369220096)]} 0 1
[junit4:junit4] 2> 752056 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[58 (1435266839369220096)]} 0 4
[junit4:junit4] 2> 752057 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[58]} 0 8
[junit4:junit4] 2> 752061 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[59 (1435266839377608704)]} 0 1
[junit4:junit4] 2> 752067 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1435266839380754432)]} 0 1
[junit4:junit4] 2> 752067 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[59 (1435266839380754432)]} 0 4
[junit4:junit4] 2> 752071 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[60 (1435266839388094464)]} 0 1
[junit4:junit4] 2> 752077 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1435266839391240192)]} 0 1
[junit4:junit4] 2> 752077 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[60 (1435266839391240192)]} 0 4
[junit4:junit4] 2> 752081 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[61 (1435266839398580224)]} 0 1
[junit4:junit4] 2> 752087 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1435266839401725952)]} 0 1
[junit4:junit4] 2> 752087 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[61 (1435266839401725952)]} 0 4
[junit4:junit4] 2> 752091 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[62 (1435266839409065984)]} 0 1
[junit4:junit4] 2> 752100 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1435266839415357440)]} 0 1
[junit4:junit4] 2> 752100 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[62 (1435266839415357440)]} 0 4
[junit4:junit4] 2> 752101 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[62]} 0 8
[junit4:junit4] 2> 752105 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[63 (1435266839423746048)]} 0 1
[junit4:junit4] 2> 752111 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1435266839426891776)]} 0 0
[junit4:junit4] 2> 752111 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[63 (1435266839426891776)]} 0 4
[junit4:junit4] 2> 752115 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[64 (1435266839434231808)]} 0 1
[junit4:junit4] 2> 752121 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1435266839437377536)]} 0 1
[junit4:junit4] 2> 752121 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[64 (1435266839437377536)]} 0 4
[junit4:junit4] 2> 752125 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[65 (1435266839444717568)]} 0 1
[junit4:junit4] 2> 752134 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[65 (1435266839451009024)]} 0 1
[junit4:junit4] 2> 752135 T1912 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[65 (1435266839451009024)]} 0 5
[junit4:junit4] 2> 752135 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[65]} 0 8
[junit4:junit4] 2> 752139 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[66 (1435266839459397632)]} 0 1
[junit4:junit4] 2> 752145 T1942 C72 P45892 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[66 (1435266839462543360)]} 0 1
[junit4:junit4] 2> 752145 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[66 (1435266839462543360)]} 0 4
[junit4:junit4] 2> 752149 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[67 (1435266839469883392)]} 0 1
[junit4:junit4] 2> 752158 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[67 (1435266839476174848)]} 0 1
[junit4:junit4] 2> 752158 T1930 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:55332/nfucv/im/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[67 (1435266839476174848)]} 0 4
[junit4:junit4] 2> 752159 T1914 C74 P55332 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[67]} 0 8
[junit4:junit4] 2> 752163 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[68 (1435266839484563456)]} 0 1
[junit4:junit4] 2> 752169 T1957 C73 P26404 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={distrib.from=http://127.0.0.1:14886/nfucv/im/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[68 (1435266839487709184)]} 0 1
[junit4:junit4] 2> 752169 T1928 C75 P14886 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=/update params={wt=javabin&version=2} {add=[68 (1435266839487709184)]} 0 4
[junit4:junit4] 2> 752173 T1888 C76 P47447 oasup.LogUpdateProcessor.finish [collection1] webapp=/nfucv/im path=
[...truncated too long message...]
[junit4:junit4] 2> "shard_state":null,
[junit4:junit4] 2> "core":"collection1_shard1_0_replica1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45892_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45892/nfucv/im"}
[junit4:junit4] 2> 932802 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:45892_nfucv%2Fim_collection1_shard1_1_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1_1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":null,
[junit4:junit4] 2> "core":"collection1_shard1_1_replica1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45892_nfucv%2Fim",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45892/nfucv/im"}
[junit4:junit4] 2> 932814 T1876 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 26404
[junit4:junit4] 2> 932814 T1876 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=593303825
[junit4:junit4] 2> 932816 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 933825 T1876 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 933826 T1876 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 933827 T1876 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@11201270
[junit4:junit4] 2> 933829 T1876 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=813,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 933830 T1876 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 933831 T1876 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 933831 T1876 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 933834 T1876 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 933834 T1876 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 933835 T1876 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index;done=false>>]
[junit4:junit4] 2> 933835 T1876 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4/index
[junit4:junit4] 2> 933836 T1876 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4;done=false>>]
[junit4:junit4] 2> 933836 T1876 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429/jetty4
[junit4:junit4] 2> 933837 T2036 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89704175726493708-127.0.0.1:26404_nfucv%2Fim-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 933839 T1876 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/nfucv/im,null}
[junit4:junit4] 2> 933910 T1876 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 933912 T1876 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:50344 50344
[junit4:junit4] 2> 933970 T1876 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 47447
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368777095429 FAILED !!!!!
[junit4:junit4] 2> 933971 T1876 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 933972 T1876 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:50344 50344
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=68EED703CFCAC5F3 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=el -Dtests.timezone=America/St_Johns -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 208s J0 | ChaosMonkeyShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:55332/nfucv/im returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([68EED703CFCAC5F3:E908591BB895A5CF]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 934002 T1876 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 208427 T1875 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 935139 T1967 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 935139 T1967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 935139 T1967 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=el, timezone=America/St_Johns
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=2,free=176178400,total=264241152
[junit4:junit4] 2> NOTE: All tests run in this JVM: [ClusterStateTest, OutputWriterTest, TestArbitraryIndexDir, SpellingQueryConverterTest, ChaosMonkeyNothingIsSafeTest, TestJmxIntegration, SampleTest, BadIndexSchemaTest, TestPerFieldSimilarity, TestSearchPerf, TestRandomDVFaceting, TestLuceneMatchVersion, TestSolrQueryParserResource, DebugComponentTest, OpenExchangeRatesOrgProviderTest, TestSolrXml, QueryParsingTest, ShardRoutingCustomTest, TestAtomicUpdateErrorCases, TestValueSourceCache, TestFastOutputStream, DisMaxRequestHandlerTest, SolrIndexConfigTest, OverseerTest, SoftAutoCommitTest, WordBreakSolrSpellCheckerTest, SolrPluginUtilsTest, TestConfig, TestFastWriter, BinaryUpdateRequestHandlerTest, TestSolrXMLSerializer, SchemaVersionSpecificBehaviorTest, TestFaceting, TestMergePolicyConfig, TestSurroundQueryParser, TestPropInject, TestIndexSearcher, TestJoin, SystemInfoHandlerTest, TestBM25SimilarityFactory, TestDynamicFieldResource, TestFieldTypeResource, DistanceFunctionTest, PolyFieldTest, QueryElevationComponentTest, UpdateRequestProcessorFactoryTest, AliasIntegrationTest, DistributedTermsComponentTest, TestCoreContainer, HighlighterTest, TestPostingsSolrHighlighter, TestCoreDiscovery, RecoveryZkTest, DateMathParserTest, SpatialFilterTest, TestFieldCollectionResource, JSONWriterTest, TestFoldingMultitermQuery, TermVectorComponentDistributedTest, DocumentAnalysisRequestHandlerTest, PeerSyncTest, TestSweetSpotSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestMultiCoreConfBootstrap, TestAnalyzedSuggestions, TestRandomFaceting, FileBasedSpellCheckerTest, TestQueryTypes, TestExtendedDismaxParser, TestCollationField, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 209.71s, 1 test, 1 error <<< FAILURES!
[...truncated 471 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 28 ignored (9 assumptions)
Total time: 49 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1255 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1255/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:30469 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:30469 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([E0A102A1059AC2BC:61478CB972C5A280]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9656 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 621578 T1153 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 621585 T1153 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1368760005723
[junit4:junit4] 2> 621587 T1153 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 621588 T1154 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 621689 T1153 oasc.ZkTestServer.run start zk server on port:24324
[junit4:junit4] 2> 621690 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 621695 T1160 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13558028 name:ZooKeeperConnection Watcher:127.0.0.1:24324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 621696 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 621697 T1153 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 621815 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 621818 T1162 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@658a57b7 name:ZooKeeperConnection Watcher:127.0.0.1:24324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 621818 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 621819 T1153 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 621899 T1153 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 621904 T1153 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 621990 T1153 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 622012 T1153 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 622013 T1153 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 622055 T1153 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 622056 T1153 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 622162 T1153 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 622163 T1153 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 622212 T1153 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 622213 T1153 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 622221 T1153 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 622223 T1153 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 622260 T1153 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 622261 T1153 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 622305 T1153 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 622306 T1153 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 622314 T1153 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 622315 T1153 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 622347 T1153 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 622348 T1153 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 622851 T1153 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 622860 T1153 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:61986
[junit4:junit4] 2> 622861 T1153 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 622862 T1153 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 622862 T1153 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368760006643
[junit4:junit4] 2> 622863 T1153 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368760006643/solr.xml
[junit4:junit4] 2> 622863 T1153 oasc.CoreContainer.<init> New CoreContainer 1426094062
[junit4:junit4] 2> 622864 T1153 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368760006643/'
[junit4:junit4] 2> 622865 T1153 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368760006643/'
[junit4:junit4] 2> 623045 T1153 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 623046 T1153 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 623046 T1153 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 623047 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 623047 T1153 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 623048 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 623048 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 623049 T1153 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 623049 T1153 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 623050 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 623075 T1153 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 623076 T1153 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:24324/solr
[junit4:junit4] 2> 623077 T1153 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 623078 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 623082 T1173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19874d8e name:ZooKeeperConnection Watcher:127.0.0.1:24324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 623083 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 623100 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 623151 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 623159 T1175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3994e1cc name:ZooKeeperConnection Watcher:127.0.0.1:24324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 623159 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 623211 T1153 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 623220 T1153 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 623248 T1153 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 623255 T1153 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61986_
[junit4:junit4] 2> 623258 T1153 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:61986_
[junit4:junit4] 2> 623308 T1153 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 623367 T1153 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 623372 T1153 oasc.Overseer.start Overseer (id=89703055735521283-127.0.0.1:61986_-n_0000000000) starting
[junit4:junit4] 2> 623414 T1153 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 623488 T1177 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 623489 T1153 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 623495 T1153 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 623530 T1153 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 623534 T1176 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 623539 T1178 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368760006643/collection1
[junit4:junit4] 2> 623540 T1178 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 623541 T1178 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 623541 T1178 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 623543 T1178 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368760006643/collection1/'
[junit4:junit4] 2> 623544 T1178 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368760006643/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 623545 T1178 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368760006643/collection1/lib/README' to classloader
[junit4:junit4] 2> 623648 T1178 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 623731 T1178 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 623833 T1178 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 623840 T1178 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 624839 T1178 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 624843 T1178 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 624845 T1178 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 624851 T1178 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 624881 T1178 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 624881 T1178 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368760006643/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/control/data/
[junit4:junit4] 2> 624881 T1178 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@678f7bca
[junit4:junit4] 2> 624882 T1178 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 624883 T1178 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/control/data
[junit4:junit4] 2> 624883 T1178 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/control/data/index/
[junit4:junit4] 2> 624883 T1178 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 624884 T1178 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/control/data/index
[junit4:junit4] 2> 624888 T1178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d3cb730 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d4edbca),segFN=segments_1,generation=1}
[junit4:junit4] 2> 624889 T1178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 624920 T1178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 624921 T1178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 624921 T1178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 624922 T1178 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 624923 T1178 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 624923 T1178 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 624923 T1178 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 624924 T1178 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 624924 T1178 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 624942 T1178 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 624950 T1178 oass.SolrIndexSearcher.<init> Opening Searcher@b043bf8 main
[junit4:junit4] 2> 624950 T1178 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/control/data/tlog
[junit4:junit4] 2> 624951 T1178 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 624952 T1178 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 624955 T1179 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b043bf8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 624957 T1178 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 624958 T1178 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 625039 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 625041 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:61986_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:61986"}
[junit4:junit4] 2> 625041 T1176 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 625041 T1176 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 625088 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 625966 T1178 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 625966 T1178 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:61986 collection:control_collection shard:shard1
[junit4:junit4] 2> 625967 T1178 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 626161 T1178 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 626195 T1178 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 626196 T1178 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 626196 T1178 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:61986/collection1/
[junit4:junit4] 2> 626197 T1178 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 626197 T1178 oasc.SyncStrategy.syncToMe http://127.0.0.1:61986/collection1/ has no replicas
[junit4:junit4] 2> 626198 T1178 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:61986/collection1/
[junit4:junit4] 2> 626198 T1178 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 626594 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 626724 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 626817 T1178 oasc.ZkController.register We are http://127.0.0.1:61986/collection1/ and leader is http://127.0.0.1:61986/collection1/
[junit4:junit4] 2> 626817 T1178 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:61986
[junit4:junit4] 2> 626817 T1178 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 626818 T1178 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 626818 T1178 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 626821 T1178 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 626823 T1153 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 626824 T1153 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 626824 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 626846 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 626848 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 626852 T1182 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54c7bff5 name:ZooKeeperConnection Watcher:127.0.0.1:24324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 626853 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 626855 T1153 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 626858 T1153 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 627196 T1153 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 627199 T1153 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30469
[junit4:junit4] 2> 627200 T1153 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 627201 T1153 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 627201 T1153 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368760010995
[junit4:junit4] 2> 627202 T1153 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368760010995/solr.xml
[junit4:junit4] 2> 627202 T1153 oasc.CoreContainer.<init> New CoreContainer 1569500171
[junit4:junit4] 2> 627203 T1153 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368760010995/'
[junit4:junit4] 2> 627204 T1153 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368760010995/'
[junit4:junit4] 2> 627435 T1153 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 627436 T1153 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 627437 T1153 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 627437 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 627438 T1153 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 627438 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 627439 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 627439 T1153 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 627440 T1153 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 627441 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 627459 T1153 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 627460 T1153 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:24324/solr
[junit4:junit4] 2> 627461 T1153 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 627462 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 627468 T1193 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e20ce61 name:ZooKeeperConnection Watcher:127.0.0.1:24324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 627469 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 627473 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 627487 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 627517 T1195 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@95097d name:ZooKeeperConnection Watcher:127.0.0.1:24324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 627517 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 627556 T1153 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 628315 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 628316 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:61986__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:61986_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:61986"}
[junit4:junit4] 2> 628341 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 628341 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 628341 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 628561 T1153 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30469_
[junit4:junit4] 2> 628568 T1153 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30469_
[junit4:junit4] 2> 628583 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 628584 T1182 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 628584 T1195 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 628584 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 628585 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 628586 T1175 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 628597 T1196 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368760010995/collection1
[junit4:junit4] 2> 628597 T1196 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 628598 T1196 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 628598 T1196 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 628600 T1196 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368760010995/collection1/'
[junit4:junit4] 2> 628602 T1196 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368760010995/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 628602 T1196 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368760010995/collection1/lib/README' to classloader
[junit4:junit4] 2> 628694 T1196 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 628783 T1196 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 628885 T1196 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 628906 T1196 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 629805 T1196 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 629808 T1196 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 629809 T1196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 629815 T1196 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 629850 T1196 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 629850 T1196 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368760010995/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty1/
[junit4:junit4] 2> 629851 T1196 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@678f7bca
[junit4:junit4] 2> 629851 T1196 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 629852 T1196 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty1
[junit4:junit4] 2> 629852 T1196 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty1/index/
[junit4:junit4] 2> 629852 T1196 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 629853 T1196 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty1/index
[junit4:junit4] 2> 629856 T1196 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a2c3181 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44292208),segFN=segments_1,generation=1}
[junit4:junit4] 2> 629856 T1196 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 629880 T1196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 629881 T1196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 629881 T1196 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 629882 T1196 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 629882 T1196 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 629883 T1196 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 629883 T1196 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 629884 T1196 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 629884 T1196 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 629899 T1196 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 629904 T1196 oass.SolrIndexSearcher.<init> Opening Searcher@7544d045 main
[junit4:junit4] 2> 629905 T1196 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty1/tlog
[junit4:junit4] 2> 629905 T1196 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 629906 T1196 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 629909 T1197 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7544d045 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 629911 T1196 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 629911 T1196 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 631352 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 631354 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30469_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30469"}
[junit4:junit4] 2> 631354 T1176 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 631354 T1176 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 631493 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 631493 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 631493 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 631919 T1196 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 631919 T1196 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30469 collection:collection1 shard:shard1
[junit4:junit4] 2> 631921 T1196 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 631976 T1196 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 631990 T1196 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 631990 T1196 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 631991 T1196 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:30469/collection1/
[junit4:junit4] 2> 631991 T1196 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 631991 T1196 oasc.SyncStrategy.syncToMe http://127.0.0.1:30469/collection1/ has no replicas
[junit4:junit4] 2> 631992 T1196 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:30469/collection1/
[junit4:junit4] 2> 631992 T1196 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 633000 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 633053 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 633053 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 633053 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 633101 T1196 oasc.ZkController.register We are http://127.0.0.1:30469/collection1/ and leader is http://127.0.0.1:30469/collection1/
[junit4:junit4] 2> 633101 T1196 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30469
[junit4:junit4] 2> 633102 T1196 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 633102 T1196 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 633103 T1196 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 633180 T1196 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 633181 T1153 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 633182 T1153 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 633183 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 633515 T1153 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 633519 T1153 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30493
[junit4:junit4] 2> 633520 T1153 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 633521 T1153 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 633521 T1153 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368760017342
[junit4:junit4] 2> 633522 T1153 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368760017342/solr.xml
[junit4:junit4] 2> 633523 T1153 oasc.CoreContainer.<init> New CoreContainer 828089514
[junit4:junit4] 2> 633524 T1153 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368760017342/'
[junit4:junit4] 2> 633525 T1153 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368760017342/'
[junit4:junit4] 2> 633697 T1153 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 633698 T1153 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 633699 T1153 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 633699 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 633700 T1153 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 633700 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 633701 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 633701 T1153 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 633702 T1153 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 633703 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 633720 T1153 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 633721 T1153 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:24324/solr
[junit4:junit4] 2> 633722 T1153 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 633723 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 633731 T1209 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@113207c6 name:ZooKeeperConnection Watcher:127.0.0.1:24324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 633731 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 633819 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 633835 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 633842 T1211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5af16eca name:ZooKeeperConnection Watcher:127.0.0.1:24324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 633842 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 633931 T1153 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 634574 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 634575 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:30469__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30469_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30469"}
[junit4:junit4] 2> 634730 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 634731 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 634730 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 634730 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 634937 T1153 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30493_
[junit4:junit4] 2> 634942 T1153 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30493_
[junit4:junit4] 2> 634986 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 634987 T1195 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 634987 T1182 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 634987 T1211 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 634987 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 634988 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 634988 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 634989 T1175 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 635000 T1212 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368760017342/collection1
[junit4:junit4] 2> 635000 T1212 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 635001 T1212 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 635002 T1212 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 635004 T1212 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368760017342/collection1/'
[junit4:junit4] 2> 635006 T1212 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368760017342/collection1/lib/README' to classloader
[junit4:junit4] 2> 635007 T1212 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368760017342/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 635073 T1212 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 635157 T1212 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 635259 T1212 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 635274 T1212 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 636097 T1212 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 636102 T1212 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 636105 T1212 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 636112 T1212 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 636146 T1212 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 636146 T1212 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368760017342/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty2/
[junit4:junit4] 2> 636147 T1212 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@678f7bca
[junit4:junit4] 2> 636148 T1212 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 636149 T1212 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty2
[junit4:junit4] 2> 636150 T1212 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty2/index/
[junit4:junit4] 2> 636150 T1212 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 636151 T1212 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty2/index
[junit4:junit4] 2> 636155 T1212 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43bbf088 lockFactory=org.apache.lucene.store.NativeFSLockFactory@545069d7),segFN=segments_1,generation=1}
[junit4:junit4] 2> 636155 T1212 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 636184 T1212 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 636185 T1212 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 636186 T1212 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 636186 T1212 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 636187 T1212 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 636187 T1212 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 636188 T1212 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 636189 T1212 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 636189 T1212 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 636231 T1212 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 636248 T1212 oass.SolrIndexSearcher.<init> Opening Searcher@138bef5 main
[junit4:junit4] 2> 636249 T1212 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty2/tlog
[junit4:junit4] 2> 636250 T1212 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 636250 T1212 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 636255 T1213 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@138bef5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 636258 T1212 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 636258 T1212 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 637751 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 637753 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30493_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30493"}
[junit4:junit4] 2> 637753 T1176 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 637753 T1176 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 637775 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 637775 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 637775 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 637775 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 638266 T1212 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 638266 T1212 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30493 collection:collection1 shard:shard2
[junit4:junit4] 2> 638267 T1212 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 638335 T1212 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 638348 T1212 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 638348 T1212 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 638348 T1212 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:30493/collection1/
[junit4:junit4] 2> 638349 T1212 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 638349 T1212 oasc.SyncStrategy.syncToMe http://127.0.0.1:30493/collection1/ has no replicas
[junit4:junit4] 2> 638349 T1212 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:30493/collection1/
[junit4:junit4] 2> 638350 T1212 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 639286 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 639327 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 639327 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 639327 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 639327 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 639356 T1212 oasc.ZkController.register We are http://127.0.0.1:30493/collection1/ and leader is http://127.0.0.1:30493/collection1/
[junit4:junit4] 2> 639356 T1212 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30493
[junit4:junit4] 2> 639356 T1212 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 639357 T1212 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 639357 T1212 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 639373 T1212 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 639375 T1153 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 639375 T1153 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 639376 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 639970 T1153 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 639974 T1153 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30501
[junit4:junit4] 2> 639975 T1153 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 639975 T1153 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 639976 T1153 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368760023533
[junit4:junit4] 2> 639977 T1153 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368760023533/solr.xml
[junit4:junit4] 2> 639977 T1153 oasc.CoreContainer.<init> New CoreContainer 1638441714
[junit4:junit4] 2> 639978 T1153 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368760023533/'
[junit4:junit4] 2> 639979 T1153 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368760023533/'
[junit4:junit4] 2> 640265 T1153 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 640266 T1153 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 640266 T1153 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 640267 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 640268 T1153 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 640268 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 640269 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 640269 T1153 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 640270 T1153 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 640270 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 640288 T1153 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 640289 T1153 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:24324/solr
[junit4:junit4] 2> 640290 T1153 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 640291 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 640299 T1225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@185215e7 name:ZooKeeperConnection Watcher:127.0.0.1:24324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 640300 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 640389 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 640413 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 640419 T1227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b7f32a7 name:ZooKeeperConnection Watcher:127.0.0.1:24324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 640419 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 640437 T1153 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 640875 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 640877 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:30493__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30493_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30493"}
[junit4:junit4] 2> 640931 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 640931 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 640931 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 640931 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 640931 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 641441 T1153 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30501_
[junit4:junit4] 2> 641444 T1153 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30501_
[junit4:junit4] 2> 641466 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 641466 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 641467 T1182 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 641466 T1211 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 641467 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 641467 T1195 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 641467 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 641468 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 641473 T1175 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 641473 T1227 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 641496 T1228 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368760023533/collection1
[junit4:junit4] 2> 641496 T1228 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 641497 T1228 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 641497 T1228 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 641499 T1228 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368760023533/collection1/'
[junit4:junit4] 2> 641508 T1228 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368760023533/collection1/lib/README' to classloader
[junit4:junit4] 2> 641509 T1228 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368760023533/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 641624 T1228 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 641717 T1228 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 641818 T1228 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 641824 T1228 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 642857 T1228 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 642862 T1228 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 642864 T1228 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 642871 T1228 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 642901 T1228 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 642902 T1228 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368760023533/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3/
[junit4:junit4] 2> 642902 T1228 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@678f7bca
[junit4:junit4] 2> 642903 T1228 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 642904 T1228 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3
[junit4:junit4] 2> 642904 T1228 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3/index/
[junit4:junit4] 2> 642904 T1228 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 642905 T1228 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3/index
[junit4:junit4] 2> 642909 T1228 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58697433 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3eb8b889),segFN=segments_1,generation=1}
[junit4:junit4] 2> 642909 T1228 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 642935 T1228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 642935 T1228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 642936 T1228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 642937 T1228 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 642938 T1228 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 642938 T1228 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 642939 T1228 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 642939 T1228 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 642940 T1228 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 642965 T1228 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 642979 T1228 oass.SolrIndexSearcher.<init> Opening Searcher@26ef8aa2 main
[junit4:junit4] 2> 642980 T1228 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3/tlog
[junit4:junit4] 2> 642981 T1228 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 642982 T1228 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 642988 T1229 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@26ef8aa2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 642991 T1228 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 642991 T1228 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 643990 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 643992 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30501_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30501"}
[junit4:junit4] 2> 643993 T1176 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 643993 T1176 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 644025 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 644026 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 644025 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 644025 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 644026 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 644996 T1228 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 644996 T1228 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30501 collection:collection1 shard:shard1
[junit4:junit4] 2> 645005 T1228 oasc.ZkController.register We are http://127.0.0.1:30501/collection1/ and leader is http://127.0.0.1:30469/collection1/
[junit4:junit4] 2> 645006 T1228 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30501
[junit4:junit4] 2> 645006 T1228 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 645006 T1228 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C86 name=collection1 org.apache.solr.core.SolrCore@567c5708 url=http://127.0.0.1:30501/collection1 node=127.0.0.1:30501_ C86_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:30501_, base_url=http://127.0.0.1:30501}
[junit4:junit4] 2> 645007 T1230 C86 P30501 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 645008 T1230 C86 P30501 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 645008 T1228 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 645008 T1230 C86 P30501 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 645009 T1230 C86 P30501 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 645010 T1153 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 645011 T1153 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 645012 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 645029 T1230 C86 P30501 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 645049 T1185 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:30501__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 645533 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 645534 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:30501__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30501_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30501"}
[junit4:junit4] 2> 645594 T1153 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 645598 T1153 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30505
[junit4:junit4] 2> 645599 T1153 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 645599 T1153 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 645600 T1153 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368760029170
[junit4:junit4] 2> 645601 T1153 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368760029170/solr.xml
[junit4:junit4] 2> 645601 T1153 oasc.CoreContainer.<init> New CoreContainer 954629736
[junit4:junit4] 2> 645602 T1153 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368760029170/'
[junit4:junit4] 2> 645603 T1153 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368760029170/'
[junit4:junit4] 2> 645603 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 645603 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 645603 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 645603 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 645603 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 645834 T1153 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 645835 T1153 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 645835 T1153 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 645836 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 645836 T1153 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 645837 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 645837 T1153 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 645838 T1153 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 645838 T1153 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 645839 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 645873 T1153 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 645874 T1153 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:24324/solr
[junit4:junit4] 2> 645875 T1153 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 645876 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 645881 T1242 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29d42291 name:ZooKeeperConnection Watcher:127.0.0.1:24324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 645881 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 645971 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 645986 T1153 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 645999 T1244 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4176c2ee name:ZooKeeperConnection Watcher:127.0.0.1:24324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 646000 T1153 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 646051 T1185 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:30501__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 646051 T1185 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:30501__collection1&state=recovering&nodeName=127.0.0.1:30501_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 646065 T1153 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 647071 T1153 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30505_
[junit4:junit4] 2> 647074 T1153 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30505_
[junit4:junit4] 2> 647101 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 647101 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 647104 T1211 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 647104 T1244 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 647104 T1182 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 647104 T1195 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 647105 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 647106 T1227 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 647104 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 647105 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 647110 T1175 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 647116 T1245 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368760029170/collection1
[junit4:junit4] 2> 647116 T1245 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 647117 T1245 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 647118 T1245 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 647119 T1245 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368760029170/collection1/'
[junit4:junit4] 2> 647121 T1245 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368760029170/collection1/lib/README' to classloader
[junit4:junit4] 2> 647122 T1245 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368760029170/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 647187 T1245 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 647263 T1245 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 647364 T1245 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 647372 T1245 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> C86_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:30501_, base_url=http://127.0.0.1:30501}
[junit4:junit4] 2> 648054 T1230 C86 P30501 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:30469/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 648054 T1230 C86 P30501 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:30501 START replicas=[http://127.0.0.1:30469/collection1/] nUpdates=100
[junit4:junit4] 2> 648055 T1230 C86 P30501 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 648055 T1230 C86 P30501 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 648055 T1230 C86 P30501 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 648056 T1230 C86 P30501 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 648056 T1230 C86 P30501 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 648056 T1230 C86 P30501 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:30469/collection1/. core=collection1
[junit4:junit4] 2> 648056 T1230 C86 P30501 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C87 name=collection1 org.apache.solr.core.SolrCore@8a5057f url=http://127.0.0.1:30469/collection1 node=127.0.0.1:30469_ C87_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:30469_, base_url=http://127.0.0.1:30469, leader=true}
[junit4:junit4] 2> 648069 T1186 C87 P30469 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 648073 T1187 C87 P30469 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 648083 T1187 C87 P30469 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a2c3181 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44292208),segFN=segments_1,generation=1}
[junit4:junit4] 2> 648084 T1187 C87 P30469 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 648086 T1187 C87 P30469 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a2c3181 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44292208),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a2c3181 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44292208),segFN=segments_2,generation=2}
[junit4:junit4] 2> 648086 T1187 C87 P30469 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 648087 T1187 C87 P30469 oass.SolrIndexSearcher.<init> Opening Searcher@8b1895d realtime
[junit4:junit4] 2> 648088 T1187 C87 P30469 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 648089 T1187 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 17
[junit4:junit4] 2> 648091 T1230 C86 P30501 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 648091 T1230 C86 P30501 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 648095 T1188 C87 P30469 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 648096 T1188 C87 P30469 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4] 2> 648097 T1230 C86 P30501 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 648098 T1230 C86 P30501 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 648098 T1230 C86 P30501 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 648100 T1188 C87 P30469 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 648102 T1230 C86 P30501 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 648103 T1230 C86 P30501 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3/index.20130517150712238
[junit4:junit4] 2> 648103 T1230 C86 P30501 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2cc200dd lockFactory=org.apache.lucene.store.NativeFSLockFactory@68d3f1c8) fullCopy=false
[junit4:junit4] 2> 648106 T1188 C87 P30469 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 648108 T1230 C86 P30501 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 648110 T1230 C86 P30501 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 648110 T1230 C86 P30501 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 648114 T1230 C86 P30501 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58697433 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3eb8b889),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58697433 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3eb8b889),segFN=segments_2,generation=2}
[junit4:junit4] 2> 648114 T1230 C86 P30501 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 648115 T1230 C86 P30501 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 648115 T1230 C86 P30501 oass.SolrIndexSearcher.<init> Opening Searcher@48256cd5 main
[junit4:junit4] 2> 648117 T1229 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48256cd5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 648117 T1230 C86 P30501 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3/index.20130517150712238 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3/index.20130517150712238;done=true>>]
[junit4:junit4] 2> 648118 T1230 C86 P30501 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3/index.20130517150712238
[junit4:junit4] 2> 648118 T1230 C86 P30501 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty3/index.20130517150712238
[junit4:junit4] 2> 648119 T1230 C86 P30501 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 648119 T1230 C86 P30501 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 648119 T1230 C86 P30501 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 648120 T1230 C86 P30501 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 648123 T1230 C86 P30501 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 648139 T1245 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 648143 T1245 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 648146 T1245 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 648151 T1245 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 648182 T1245 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 648183 T1245 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368760029170/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/
[junit4:junit4] 2> 648183 T1245 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@678f7bca
[junit4:junit4] 2> 648184 T1245 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 648184 T1245 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4
[junit4:junit4] 2> 648185 T1245 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index/
[junit4:junit4] 2> 648185 T1245 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 648186 T1245 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index
[junit4:junit4] 2> 648189 T1245 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4df7cd8e lockFactory=org.apache.lucene.store.NativeFSLockFactory@94611a),segFN=segments_1,generation=1}
[junit4:junit4] 2> 648190 T1245 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 648210 T1245 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 648210 T1245 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 648211 T1245 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 648212 T1245 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 648213 T1245 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 648213 T1245 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 648214 T1245 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 648215 T1245 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 648216 T1245 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 648231 T1245 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 648245 T1245 oass.SolrIndexSearcher.<init> Opening Searcher@d375985 main
[junit4:junit4] 2> 648246 T1245 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/tlog
[junit4:junit4] 2> 648247 T1245 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 648247 T1245 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 648253 T1248 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d375985 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 648255 T1245 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 648256 T1245 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 648617 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 648618 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:30501__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30501_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30501"}
[junit4:junit4] 2> 648623 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30505_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30505"}
[junit4:junit4] 2> 648624 T1176 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 648624 T1176 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 648661 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 648661 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 648661 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 648661 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 648661 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 648661 T1244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 649259 T1245 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 649259 T1245 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30505 collection:collection1 shard:shard2
[junit4:junit4] 2> 649268 T1245 oasc.ZkController.register We are http://127.0.0.1:30505/collection1/ and leader is http://127.0.0.1:30493/collection1/
[junit4:junit4] 2> 649268 T1245 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30505
[junit4:junit4] 2> 649268 T1245 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 649269 T1245 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C88 name=collection1 org.apache.solr.core.SolrCore@396f23ea url=http://127.0.0.1:30505/collection1 node=127.0.0.1:30505_ C88_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:30505_, base_url=http://127.0.0.1:30505}
[junit4:junit4] 2> 649270 T1249 C88 P30505 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 649271 T1245 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 649271 T1249 C88 P30505 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 649271 T1249 C88 P30505 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 649271 T1249 C88 P30505 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 649272 T1153 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 649273 T1153 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 649273 T1153 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 649350 T1249 C88 P30505 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 649350 T1153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 649352 T1153 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 649353 T1153 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 649354 T1153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 649368 T1201 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:30505__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 650211 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 650212 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:30505__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30505_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30505"}
[junit4:junit4] 2> 650369 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 650369 T1153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 650369 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 650369 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 650369 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 650369 T1244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 650369 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 651371 T1201 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:30505__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 651371 T1201 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:30505__collection1&state=recovering&nodeName=127.0.0.1:30505_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 651372 T1153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 652376 T1153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C88_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:30505_, base_url=http://127.0.0.1:30505}
[junit4:junit4] 2> 653373 T1249 C88 P30505 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:30493/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 653373 T1249 C88 P30505 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:30505 START replicas=[http://127.0.0.1:30493/collection1/] nUpdates=100
[junit4:junit4] 2> 653374 T1249 C88 P30505 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 653374 T1249 C88 P30505 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 653374 T1249 C88 P30505 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 653374 T1249 C88 P30505 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 653374 T1249 C88 P30505 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 653374 T1249 C88 P30505 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:30493/collection1/. core=collection1
[junit4:junit4] 2> 653375 T1249 C88 P30505 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 653378 T1153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C89 name=collection1 org.apache.solr.core.SolrCore@4233470f url=http://127.0.0.1:30493/collection1 node=127.0.0.1:30493_ C89_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:30493_, base_url=http://127.0.0.1:30493, leader=true}
[junit4:junit4] 2> 653386 T1202 C89 P30493 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 653388 T1203 C89 P30493 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 653390 T1203 C89 P30493 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43bbf088 lockFactory=org.apache.lucene.store.NativeFSLockFactory@545069d7),segFN=segments_1,generation=1}
[junit4:junit4] 2> 653391 T1203 C89 P30493 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 653392 T1203 C89 P30493 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43bbf088 lockFactory=org.apache.lucene.store.NativeFSLockFactory@545069d7),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43bbf088 lockFactory=org.apache.lucene.store.NativeFSLockFactory@545069d7),segFN=segments_2,generation=2}
[junit4:junit4] 2> 653392 T1203 C89 P30493 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 653392 T1203 C89 P30493 oass.SolrIndexSearcher.<init> Opening Searcher@5cc2c07f realtime
[junit4:junit4] 2> 653393 T1203 C89 P30493 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 653393 T1203 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 653394 T1249 C88 P30505 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 653394 T1249 C88 P30505 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 653396 T1204 C89 P30493 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 653396 T1204 C89 P30493 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 653397 T1249 C88 P30505 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 653397 T1249 C88 P30505 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 653397 T1249 C88 P30505 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 653399 T1204 C89 P30493 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 653400 T1249 C88 P30505 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 653401 T1249 C88 P30505 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index.20130517150717537
[junit4:junit4] 2> 653402 T1249 C88 P30505 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@bf1054e lockFactory=org.apache.lucene.store.NativeFSLockFactory@22a5cdce) fullCopy=false
[junit4:junit4] 2> 653405 T1204 C89 P30493 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 653406 T1249 C88 P30505 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 653407 T1249 C88 P30505 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 653407 T1249 C88 P30505 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 653413 T1249 C88 P30505 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4df7cd8e lockFactory=org.apache.lucene.store.NativeFSLockFactory@94611a),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4df7cd8e lockFactory=org.apache.lucene.store.NativeFSLockFactory@94611a),segFN=segments_2,generation=2}
[junit4:junit4] 2> 653413 T1249 C88 P30505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 653414 T1249 C88 P30505 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 653414 T1249 C88 P30505 oass.SolrIndexSearcher.<init> Opening Searcher@3639b0c2 main
[junit4:junit4] 2> 653415 T1248 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3639b0c2 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 653416 T1249 C88 P30505 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index.20130517150717537 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index.20130517150717537;done=true>>]
[junit4:junit4] 2> 653416 T1249 C88 P30505 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index.20130517150717537
[junit4:junit4] 2> 653417 T1249 C88 P30505 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index.20130517150717537
[junit4:junit4] 2> 653417 T1249 C88 P30505 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 653417 T1249 C88 P30505 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 653417 T1249 C88 P30505 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 653418 T1249 C88 P30505 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 653420 T1249 C88 P30505 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 654382 T1153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 654883 T1176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 654885 T1176 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:30505__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30505_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30505"}
[junit4:junit4] 2> 654909 T1211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 654910 T1244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 654910 T1182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 654910 T1175 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 654910 T1227 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 654909 T1195 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 655385 T1153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 655386 T1153 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C90 name=collection1 org.apache.solr.core.SolrCore@154f9 url=http://127.0.0.1:61986/collection1 node=127.0.0.1:61986_ C90_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:61986_, base_url=http://127.0.0.1:61986, leader=true}
[junit4:junit4] 2> 655400 T1165 C90 P61986 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 655432 T1165 C90 P61986 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d3cb730 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d4edbca),segFN=segments_1,generation=1}
[junit4:junit4] 2> 655433 T1165 C90 P61986 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 655434 T1165 C90 P61986 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d3cb730 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d4edbca),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5d3cb730 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d4edbca),segFN=segments_2,generation=2}
[junit4:junit4] 2> 655434 T1165 C90 P61986 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 655434 T1165 C90 P61986 oass.SolrIndexSearcher.<init> Opening Searcher@6d83823e main
[junit4:junit4] 2> 655435 T1165 C90 P61986 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 655436 T1179 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d83823e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 655436 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 36
[junit4:junit4] 2> 655447 T1205 C89 P30493 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 655448 T1205 C89 P30493 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43bbf088 lockFactory=org.apache.lucene.store.NativeFSLockFactory@545069d7),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@43bbf088 lockFactory=org.apache.lucene.store.NativeFSLockFactory@545069d7),segFN=segments_3,generation=3}
[junit4:junit4] 2> 655449 T1205 C89 P30493 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 655449 T1205 C89 P30493 oass.SolrIndexSearcher.<init> Opening Searcher@d92e3d5 main
[junit4:junit4] 2> 655450 T1205 C89 P30493 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 655451 T1213 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d92e3d5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 655452 T1205 C89 P30493 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:30469/collection1/, StdNode: http://127.0.0.1:30501/collection1/, StdNode: http://127.0.0.1:30505/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 655455 T1189 C87 P30469 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 655456 T1189 C87 P30469 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a2c3181 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44292208),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a2c3181 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44292208),segFN=segments_3,generation=3}
[junit4:junit4] 2> 655456 T1189 C87 P30469 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 655457 T1189 C87 P30469 oass.SolrIndexSearcher.<init> Opening Searcher@45517af1 main
[junit4:junit4] 2> 655458 T1189 C87 P30469 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 655458 T1197 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@45517af1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 655459 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> C88_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:30505_, base_url=http://127.0.0.1:30505}
[junit4:junit4] 2> 655463 T1234 C88 P30505 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C86_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:30501_, base_url=http://127.0.0.1:30501}
[junit4:junit4] 2> 655463 T1217 C86 P30501 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 655465 T1234 C88 P30505 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4df7cd8e lockFactory=org.apache.lucene.store.NativeFSLockFactory@94611a),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4df7cd8e lockFactory=org.apache.lucene.store.NativeFSLockFactory@94611a),segFN=segments_3,generation=3}
[junit4:junit4] 2> 655465 T1217 C86 P30501 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58697433 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3eb8b889),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@58697433 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3eb8b889),segFN=segments_3,generation=3}
[junit4:junit4] 2> 655466 T1234 C88 P30505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 655466 T1217 C86 P30501 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 655467 T1234 C88 P30505 oass.SolrIndexSearcher.<init> Opening Searcher@4b12c192 main
[junit4:junit4] 2> 655467 T1217 C86 P30501 oass.SolrIndexSearcher.<init> Opening Searcher@4d6c9c9 main
[junit4:junit4] 2> 655468 T1234 C88 P30505 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 655468 T1217 C86 P30501 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 655469 T1229 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4d6c9c9 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 655469 T1248 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4b12c192 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 655470 T1217 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 655470 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 655471 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 24
[junit4:junit4] 2> 655472 T1153 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 655475 T1190 C87 P30469 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 655478 T1218 C86 P30501 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 655480 T1206 C89 P30493 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 655482 T1235 C88 P30505 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 657489 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435248929404878848)} 0 2
[junit4:junit4] 2> 657499 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435248929410121728&update.from=http://127.0.0.1:30469/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435248929410121728)} 0 2
[junit4:junit4] 2> 657507 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435248929415364608&update.from=http://127.0.0.1:30493/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435248929415364608)} 0 6
[junit4:junit4] 2> 657508 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435248929415364608)} 0 11
[junit4:junit4] 2> 657509 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435248929410121728)} 0 17
[junit4:junit4] 2> 657513 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1435248929432141824)]} 0 1
[junit4:junit4] 2> 657520 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435248929435287552)]} 0 1
[junit4:junit4] 2> 657521 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1435248929435287552)]} 0 5
[junit4:junit4] 2> 657525 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435248929443676160)]} 0 1
[junit4:junit4] 2> 657532 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435248929447870464)]} 0 1
[junit4:junit4] 2> 657533 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435248929447870464)]} 0 5
[junit4:junit4] 2> 657537 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1435248929457307648)]} 0 1
[junit4:junit4] 2> 657544 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435248929461501952)]} 0 1
[junit4:junit4] 2> 657545 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1435248929461501952)]} 0 5
[junit4:junit4] 2> 657549 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435248929469890560)]} 0 1
[junit4:junit4] 2> 657556 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435248929474084864)]} 0 1
[junit4:junit4] 2> 657557 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435248929474084864)]} 0 5
[junit4:junit4] 2> 657561 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435248929482473472)]} 0 1
[junit4:junit4] 2> 657568 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435248929486667776)]} 0 1
[junit4:junit4] 2> 657569 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435248929486667776)]} 0 5
[junit4:junit4] 2> 657573 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1435248929495056384)]} 0 1
[junit4:junit4] 2> 657583 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435248929501347840)]} 0 1
[junit4:junit4] 2> 657584 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1435248929501347840)]} 0 5
[junit4:junit4] 2> 657585 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5]} 0 9
[junit4:junit4] 2> 657589 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1435248929511833600)]} 0 1
[junit4:junit4] 2> 657597 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435248929517076480)]} 0 1
[junit4:junit4] 2> 657598 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1435248929517076480)]} 0 5
[junit4:junit4] 2> 657602 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1435248929525465088)]} 0 1
[junit4:junit4] 2> 657613 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435248929533853696)]} 0 1
[junit4:junit4] 2> 657614 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1435248929533853696)]} 0 5
[junit4:junit4] 2> 657615 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7]} 0 8
[junit4:junit4] 2> 657619 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435248929542242304)]} 0 1
[junit4:junit4] 2> 657629 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435248929549582336)]} 0 1
[junit4:junit4] 2> 657630 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1435248929549582336)]} 0 5
[junit4:junit4] 2> 657630 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8]} 0 8
[junit4:junit4] 2> 657634 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1435248929559019520)]} 0 1
[junit4:junit4] 2> 657646 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435248929567408128)]} 0 1
[junit4:junit4] 2> 657647 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1435248929567408128)]} 0 5
[junit4:junit4] 2> 657648 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9]} 0 10
[junit4:junit4] 2> 657652 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1435248929577893888)]} 0 1
[junit4:junit4] 2> 657662 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435248929584185344)]} 0 1
[junit4:junit4] 2> 657663 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1435248929584185344)]} 0 5
[junit4:junit4] 2> 657663 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10]} 0 8
[junit4:junit4] 2> 657667 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1435248929592573952)]} 0 1
[junit4:junit4] 2> 657677 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435248929600962560)]} 0 1
[junit4:junit4] 2> 657678 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1435248929600962560)]} 0 5
[junit4:junit4] 2> 657678 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11]} 0 8
[junit4:junit4] 2> 657682 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1435248929608302592)]} 0 1
[junit4:junit4] 2> 657692 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435248929615642624)]} 0 1
[junit4:junit4] 2> 657693 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[12 (1435248929615642624)]} 0 5
[junit4:junit4] 2> 657694 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12]} 0 9
[junit4:junit4] 2> 657698 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1435248929625079808)]} 0 1
[junit4:junit4] 2> 657709 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435248929633468416)]} 0 1
[junit4:junit4] 2> 657710 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[13 (1435248929633468416)]} 0 5
[junit4:junit4] 2> 657710 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13]} 0 9
[junit4:junit4] 2> 657715 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1435248929642905600)]} 0 1
[junit4:junit4] 2> 657725 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435248929650245632)]} 0 1
[junit4:junit4] 2> 657725 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1435248929650245632)]} 0 4
[junit4:junit4] 2> 657726 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14]} 0 8
[junit4:junit4] 2> 657730 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435248929659682816)]} 0 1
[junit4:junit4] 2> 657736 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435248929662828544)]} 0 0
[junit4:junit4] 2> 657738 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435248929662828544)]} 0 5
[junit4:junit4] 2> 657743 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1435248929672265728)]} 0 0
[junit4:junit4] 2> 657754 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435248929680654336)]} 0 1
[junit4:junit4] 2> 657755 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[16 (1435248929680654336)]} 0 6
[junit4:junit4] 2> 657757 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16]} 0 11
[junit4:junit4] 2> 657761 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1435248929692188672)]} 0 1
[junit4:junit4] 2> 657769 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435248929697431552)]} 0 1
[junit4:junit4] 2> 657770 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1435248929697431552)]} 0 5
[junit4:junit4] 2> 657773 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1435248929704771584)]} 0 1
[junit4:junit4] 2> 657781 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435248929708965888)]} 0 1
[junit4:junit4] 2> 657782 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1435248929708965888)]} 0 5
[junit4:junit4] 2> 657786 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1435248929718403072)]} 0 0
[junit4:junit4] 2> 657797 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435248929726791680)]} 0 1
[junit4:junit4] 2> 657798 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[19 (1435248929726791680)]} 0 5
[junit4:junit4] 2> 657798 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19]} 0 8
[junit4:junit4] 2> 657803 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1435248929736228864)]} 0 1
[junit4:junit4] 2> 657811 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435248929740423168)]} 0 1
[junit4:junit4] 2> 657812 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1435248929740423168)]} 0 5
[junit4:junit4] 2> 657816 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1435248929749860352)]} 0 1
[junit4:junit4] 2> 657824 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435248929754054656)]} 0 1
[junit4:junit4] 2> 657825 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1435248929754054656)]} 0 5
[junit4:junit4] 2> 657829 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1435248929763491840)]} 0 1
[junit4:junit4] 2> 657840 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435248929770831872)]} 0 0
[junit4:junit4] 2> 657841 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1435248929770831872)]} 0 5
[junit4:junit4] 2> 657842 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22]} 0 9
[junit4:junit4] 2> 657846 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1435248929781317632)]} 0 1
[junit4:junit4] 2> 657857 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435248929788657664)]} 0 1
[junit4:junit4] 2> 657858 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[23 (1435248929788657664)]} 0 6
[junit4:junit4] 2> 657859 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23]} 0 10
[junit4:junit4] 2> 657863 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24 (1435248929799143424)]} 0 1
[junit4:junit4] 2> 657873 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435248929805434880)]} 0 1
[junit4:junit4] 2> 657874 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[24 (1435248929805434880)]} 0 5
[junit4:junit4] 2> 657875 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24]} 0 8
[junit4:junit4] 2> 657879 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1435248929815920640)]} 0 1
[junit4:junit4] 2> 657889 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435248929822212096)]} 0 1
[junit4:junit4] 2> 657890 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1435248929822212096)]} 0 5
[junit4:junit4] 2> 657890 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25]} 0 8
[junit4:junit4] 2> 657894 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26 (1435248929830600704)]} 0 1
[junit4:junit4] 2> 657904 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435248929838989312)]} 0 1
[junit4:junit4] 2> 657905 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1435248929838989312)]} 0 5
[junit4:junit4] 2> 657906 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26]} 0 9
[junit4:junit4] 2> 657910 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27 (1435248929847377920)]} 0 1
[junit4:junit4] 2> 657920 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435248929855766528)]} 0 1
[junit4:junit4] 2> 657921 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[27 (1435248929855766528)]} 0 5
[junit4:junit4] 2> 657922 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27]} 0 9
[junit4:junit4] 2> 657926 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28 (1435248929865203712)]} 0 1
[junit4:junit4] 2> 657934 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435248929870446592)]} 0 1
[junit4:junit4] 2> 657936 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28 (1435248929870446592)]} 0 6
[junit4:junit4] 2> 657941 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1435248929880932352)]} 0 0
[junit4:junit4] 2> 657951 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435248929887223808)]} 0 1
[junit4:junit4] 2> 657952 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[29 (1435248929887223808)]} 0 5
[junit4:junit4] 2> 657952 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29]} 0 8
[junit4:junit4] 2> 657956 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1435248929896660992)]} 0 1
[junit4:junit4] 2> 657966 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435248929902952448)]} 0 1
[junit4:junit4] 2> 657967 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[30 (1435248929902952448)]} 0 5
[junit4:junit4] 2> 657968 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30]} 0 9
[junit4:junit4] 2> 657972 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1435248929913438208)]} 0 1
[junit4:junit4] 2> 657979 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435248929917632512)]} 0 1
[junit4:junit4] 2> 657980 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1435248929917632512)]} 0 5
[junit4:junit4] 2> 657984 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1435248929926021120)]} 0 1
[junit4:junit4] 2> 657992 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435248929930215424)]} 0 1
[junit4:junit4] 2> 657993 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1435248929930215424)]} 0 6
[junit4:junit4] 2> 657997 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1435248929939652608)]} 0 1
[junit4:junit4] 2> 658005 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435248929944895488)]} 0 1
[junit4:junit4] 2> 658006 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1435248929944895488)]} 0 5
[junit4:junit4] 2> 658011 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34 (1435248929954332672)]} 0 0
[junit4:junit4] 2> 658022 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1435248929962721280)]} 0 1
[junit4:junit4] 2> 658024 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[34 (1435248929962721280)]} 0 6
[junit4:junit4] 2> 658025 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34]} 0 10
[junit4:junit4] 2> 658029 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35 (1435248929973207040)]} 0 0
[junit4:junit4] 2> 658038 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1435248929978449920)]} 0 1
[junit4:junit4] 2> 658039 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35 (1435248929978449920)]} 0 5
[junit4:junit4] 2> 658043 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36 (1435248929987887104)]} 0 1
[junit4:junit4] 2> 658051 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1435248929993129984)]} 0 1
[junit4:junit4] 2> 658052 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36 (1435248929993129984)]} 0 5
[junit4:junit4] 2> 658056 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37 (1435248930001518592)]} 0 0
[junit4:junit4] 2> 658064 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1435248930006761472)]} 0 1
[junit4:junit4] 2> 658065 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37 (1435248930006761472)]} 0 5
[junit4:junit4] 2> 658069 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38 (1435248930015150080)]} 0 1
[junit4:junit4] 2> 658079 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1435248930021441536)]} 0 1
[junit4:junit4] 2> 658080 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[38 (1435248930021441536)]} 0 5
[junit4:junit4] 2> 658081 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38]} 0 8
[junit4:junit4] 2> 658086 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39 (1435248930032975872)]} 0 1
[junit4:junit4] 2> 658097 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1435248930040315904)]} 0 1
[junit4:junit4] 2> 658098 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[39 (1435248930040315904)]} 0 6
[junit4:junit4] 2> 658099 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39]} 0 10
[junit4:junit4] 2> 658104 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1435248930051850240)]} 0 1
[junit4:junit4] 2> 658111 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1435248930056044544)]} 0 1
[junit4:junit4] 2> 658112 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1435248930056044544)]} 0 5
[junit4:junit4] 2> 658116 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1435248930064433152)]} 0 1
[junit4:junit4] 2> 658123 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1435248930068627456)]} 0 1
[junit4:junit4] 2> 658124 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1435248930068627456)]} 0 5
[junit4:junit4] 2> 658128 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1435248930077016064)]} 0 1
[junit4:junit4] 2> 658138 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1435248930083307520)]} 0 1
[junit4:junit4] 2> 658139 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[42 (1435248930083307520)]} 0 5
[junit4:junit4] 2> 658140 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42]} 0 8
[junit4:junit4] 2> 658144 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1435248930093793280)]} 0 1
[junit4:junit4] 2> 658151 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1435248930097987584)]} 0 1
[junit4:junit4] 2> 658152 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1435248930097987584)]} 0 5
[junit4:junit4] 2> 658156 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1435248930106376192)]} 0 1
[junit4:junit4] 2> 658163 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1435248930109521920)]} 0 1
[junit4:junit4] 2> 658164 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1435248930109521920)]} 0 5
[junit4:junit4] 2> 658169 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45 (1435248930120007680)]} 0 1
[junit4:junit4] 2> 658180 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1435248930127347712)]} 0 1
[junit4:junit4] 2> 658181 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[45 (1435248930127347712)]} 0 6
[junit4:junit4] 2> 658182 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45]} 0 10
[junit4:junit4] 2> 658186 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46 (1435248930137833472)]} 0 1
[junit4:junit4] 2> 658196 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1435248930144124928)]} 0 1
[junit4:junit4] 2> 658198 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[46 (1435248930144124928)]} 0 6
[junit4:junit4] 2> 658199 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46]} 0 9
[junit4:junit4] 2> 658202 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47 (1435248930154610688)]} 0 1
[junit4:junit4] 2> 658213 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1435248930161950720)]} 0 1
[junit4:junit4] 2> 658215 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[47 (1435248930161950720)]} 0 6
[junit4:junit4] 2> 658216 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47]} 0 11
[junit4:junit4] 2> 658220 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48 (1435248930173485056)]} 0 0
[junit4:junit4] 2> 658228 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1435248930177679360)]} 0 1
[junit4:junit4] 2> 658229 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48 (1435248930177679360)]} 0 6
[junit4:junit4] 2> 658233 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49 (1435248930187116544)]} 0 1
[junit4:junit4] 2> 658240 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1435248930191310848)]} 0 1
[junit4:junit4] 2> 658241 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49 (1435248930191310848)]} 0 5
[junit4:junit4] 2> 658246 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1435248930200748032)]} 0 1
[junit4:junit4] 2> 658254 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1435248930204942336)]} 0 1
[junit4:junit4] 2> 658255 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1435248930204942336)]} 0 6
[junit4:junit4] 2> 658260 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51 (1435248930215428096)]} 0 1
[junit4:junit4] 2> 658268 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1435248930219622400)]} 0 0
[junit4:junit4] 2> 658270 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51 (1435248930219622400)]} 0 7
[junit4:junit4] 2> 658274 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52 (1435248930230108160)]} 0 1
[junit4:junit4] 2> 658284 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1435248930237448192)]} 0 1
[junit4:junit4] 2> 658285 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[52 (1435248930237448192)]} 0 5
[junit4:junit4] 2> 658286 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52]} 0 9
[junit4:junit4] 2> 658290 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53 (1435248930246885376)]} 0 1
[junit4:junit4] 2> 658297 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1435248930250031104)]} 0 1
[junit4:junit4] 2> 658298 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53 (1435248930250031104)]} 0 5
[junit4:junit4] 2> 658302 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54 (1435248930259468288)]} 0 1
[junit4:junit4] 2> 658310 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1435248930264711168)]} 0 1
[junit4:junit4] 2> 658311 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54 (1435248930264711168)]} 0 5
[junit4:junit4] 2> 658315 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55 (1435248930273099776)]} 0 1
[junit4:junit4] 2> 658325 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1435248930280439808)]} 0 1
[junit4:junit4] 2> 658326 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[55 (1435248930280439808)]} 0 5
[junit4:junit4] 2> 658327 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55]} 0 9
[junit4:junit4] 2> 658331 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1435248930289876992)]} 0 0
[junit4:junit4] 2> 658339 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1435248930295119872)]} 0 1
[junit4:junit4] 2> 658340 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1435248930295119872)]} 0 5
[junit4:junit4] 2> 658344 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57 (1435248930303508480)]} 0 1
[junit4:junit4] 2> 658351 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1435248930307702784)]} 0 1
[junit4:junit4] 2> 658352 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57 (1435248930307702784)]} 0 5
[junit4:junit4] 2> 658356 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58 (1435248930316091392)]} 0 1
[junit4:junit4] 2> 658366 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1435248930323431424)]} 0 1
[junit4:junit4] 2> 658367 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[58 (1435248930323431424)]} 0 5
[junit4:junit4] 2> 658368 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58]} 0 9
[junit4:junit4] 2> 658372 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59 (1435248930332868608)]} 0 1
[junit4:junit4] 2> 658379 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1435248930337062912)]} 0 1
[junit4:junit4] 2> 658380 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59 (1435248930337062912)]} 0 5
[junit4:junit4] 2> 658384 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60 (1435248930345451520)]} 0 1
[junit4:junit4] 2> 658394 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1435248930352791552)]} 0 1
[junit4:junit4] 2> 658395 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[60 (1435248930352791552)]} 0 5
[junit4:junit4] 2> 658396 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60]} 0 9
[junit4:junit4] 2> 658400 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61 (1435248930362228736)]} 0 1
[junit4:junit4] 2> 658407 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1435248930365374464)]} 0 1
[junit4:junit4] 2> 658408 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61 (1435248930365374464)]} 0 5
[junit4:junit4] 2> 658412 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62 (1435248930373763072)]} 0 1
[junit4:junit4] 2> 658423 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1435248930382151680)]} 0 1
[junit4:junit4] 2> 658424 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[62 (1435248930382151680)]} 0 6
[junit4:junit4] 2> 658425 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62]} 0 10
[junit4:junit4] 2> 658429 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63 (1435248930392637440)]} 0 1
[junit4:junit4] 2> 658438 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1435248930397880320)]} 0 1
[junit4:junit4] 2> 658439 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63 (1435248930397880320)]} 0 5
[junit4:junit4] 2> 658443 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64 (1435248930407317504)]} 0 1
[junit4:junit4] 2> 658454 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1435248930415706112)]} 0 1
[junit4:junit4] 2> 658455 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[64 (1435248930415706112)]} 0 5
[junit4:junit4] 2> 658456 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64]} 0 9
[junit4:junit4] 2> 658460 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65 (1435248930425143296)]} 0 1
[junit4:junit4] 2> 658471 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[65 (1435248930432483328)]} 0 1
[junit4:junit4] 2> 658472 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[65 (1435248930432483328)]} 0 6
[junit4:junit4] 2> 658473 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65]} 0 10
[junit4:junit4] 2> 658477 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66 (1435248930442969088)]} 0 1
[junit4:junit4] 2> 658484 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[66 (1435248930446114816)]} 0 1
[junit4:junit4] 2> 658486 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66 (1435248930446114816)]} 0 6
[junit4:junit4] 2> 658490 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[67 (1435248930456600576)]} 0 1
[junit4:junit4] 2> 658500 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[67 (1435248930463940608)]} 0 1
[junit4:junit4] 2> 658501 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[67 (1435248930463940608)]} 0 5
[junit4:junit4] 2> 658502 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[67]} 0 9
[junit4:junit4] 2> 658506 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[68 (1435248930473377792)]} 0 1
[junit4:junit4] 2> 658513 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[68 (1435248930476523520)]} 0 1
[junit4:junit4] 2> 658514 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[68 (1435248930476523520)]} 0 5
[junit4:junit4] 2> 658518 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[69 (1435248930485960704)]} 0 1
[junit4:junit4] 2> 658529 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[69 (1435248930493300736)]} 0 1
[junit4:junit4] 2> 658530 T1207 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[69 (1435248930493300736)]} 0 5
[junit4:junit4] 2> 658531 T1191 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[69]} 0 10
[junit4:junit4] 2> 658535 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[70 (1435248930503786496)]} 0 0
[junit4:junit4] 2> 658546 T1219 C86 P30501 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30469/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[70 (1435248930511126528)]} 0 0
[junit4:junit4] 2> 658548 T1189 C87 P30469 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:30493/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[70 (1435248930511126528)]} 0 6
[junit4:junit4] 2> 658549 T1205 C89 P30493 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[70]} 0 10
[junit4:junit4] 2> 658553 T1165 C90 P61986 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[71 (1435248930522660864)]} 0 1
[junit4:junit4] 2> 658563 T1234 C88 P30505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/up
[...truncated too long message...]
g.Thread.run(Thread.java:722)
[junit4:junit4] 2> 801261 T1153 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 827100 T1244 oasu.PeerSync.handleResponse WARN PeerSync: core=collection1 url=http://127.0.0.1:30505 couldn't connect to http://127.0.0.1:30493/collection1/, counting as success
[junit4:junit4] 2> 827100 T1244 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:30505 DONE. sync succeeded
[junit4:junit4] 2> 827101 T1244 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 827102 T1244 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4] 2> 827102 T1244 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:30505/collection1/
[junit4:junit4] 2> 827103 T1244 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@396f23ea
[junit4:junit4] 2> 827104 T1244 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=620,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 827104 T1244 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 827104 T1244 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 827104 T1244 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 827206 T1244 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 827207 T1244 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 827207 T1244 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index;done=false>>]
[junit4:junit4] 2> 827208 T1244 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4/index
[junit4:junit4] 2> 827208 T1244 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4;done=false>>]
[junit4:junit4] 2> 827208 T1244 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368760005722/jetty4
[junit4:junit4] 2> 827209 T1244 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 827209 T1244 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89703055735521292-127.0.0.1:30505__collection1-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 827211 T1244 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 827211 T1244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 827211 T1244 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 827212 T1244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 827212 T1244 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 827212 T1244 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=Pulsing41(freqCutoff=4 minBlockSize=92 maxBlockSize=230), _version_=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{}, sim=DefaultSimilarity, locale=ja_JP_JP_#u-ca-japanese, timezone=NZ
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=3,free=229540944,total=498073600
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestCollationField, AutoCommitTest, StatelessScriptUpdateProcessorFactoryTest, TestFunctionQuery, TestRecovery, TestLazyCores, TestPluginEnable, DateFieldTest, PeerSyncTest, TestRealTimeGet, XsltUpdateRequestHandlerTest, SimpleFacetsTest, SolrIndexSplitterTest, CopyFieldTest, TestPHPSerializedResponseWriter, TestRandomFaceting, TestWriterPerf, CoreContainerCoreInitFailuresTest, QueryParsingTest, IndexSchemaTest, TestTrie, TestCharFilters, TestManagedSchema, TestManagedSchemaFieldResource, TestElisionMultitermQuery, ShowFileRequestHandlerTest, TestMaxScoreQueryParser, TestSchemaNameResource, FileBasedSpellCheckerTest, QueryResultKeyTest, DebugComponentTest, TestJmxMonitoredMap, TestFieldResource, TestSearchPerf, TestReversedWildcardFilterFactory, PathHierarchyTokenizerFactoryTest, CurrencyFieldXmlFileTest, TestStressRecovery, TestArbitraryIndexDir, FullSolrCloudDistribCmdsTest, IndexReaderFactoryTest, UnloadDistributedZkTest, TestBinaryField, TestLFUCache, CircularListTest, HighlighterConfigTest, TestCollationKeyRangeQueries, LegacyHTMLStripCharFilterTest, TestCopyFieldCollectionResource, JSONWriterTest, TestQueryTypes, BasicZkTest, DocValuesMultiTest, DocumentAnalysisRequestHandlerTest, SuggesterTest, TestIBSimilarityFactory, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 205.78s, 1 test, 1 error <<< FAILURES!
[...truncated 535 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 27 ignored (8 assumptions)
Total time: 64 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1254 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1254/
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
There are still nodes recoverying - waited for 230 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
at __randomizedtesting.SeedInfo.seed([8DB8DC7356337E33:C5E526B216C1E0F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9570 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4] 2> 577380 T1733 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /s_kra/
[junit4:junit4] 2> 577384 T1733 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1368735254747
[junit4:junit4] 2> 577385 T1733 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 577386 T1734 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 577487 T1733 oasc.ZkTestServer.run start zk server on port:25950
[junit4:junit4] 2> 577505 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 577509 T1740 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b14bee1 name:ZooKeeperConnection Watcher:127.0.0.1:25950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 577509 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 577509 T1733 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 577514 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 577523 T1742 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@591f4da4 name:ZooKeeperConnection Watcher:127.0.0.1:25950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 577523 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 577524 T1733 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 577550 T1733 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 577553 T1733 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 577555 T1733 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 577565 T1733 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 577565 T1733 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 577578 T1733 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 577579 T1733 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 577682 T1733 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 577683 T1733 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 577686 T1733 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 577686 T1733 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 577689 T1733 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 577689 T1733 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 577699 T1733 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 577700 T1733 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 577703 T1733 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 577704 T1733 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 577715 T1733 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 577716 T1733 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 577720 T1733 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 577720 T1733 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 578101 T1733 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 578140 T1733 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:12626
[junit4:junit4] 2> 578141 T1733 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 578142 T1733 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 578142 T1733 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100
[junit4:junit4] 2> 578143 T1733 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/solr.xml
[junit4:junit4] 2> 578143 T1733 oasc.CoreContainer.<init> New CoreContainer 1679233898
[junit4:junit4] 2> 578144 T1733 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/'
[junit4:junit4] 2> 578145 T1733 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/'
[junit4:junit4] 2> 578246 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100
[junit4:junit4] 2> 578248 T1733 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/conf/core.properties, adding to cores
[junit4:junit4] 2> 578250 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/collection1
[junit4:junit4] 2> 578251 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/collection1/lib
[junit4:junit4] 2> 578252 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/collection1/lib/classes
[junit4:junit4] 2> 578253 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/collection1/conf
[junit4:junit4] 2> 578283 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/collection1/conf/xslt
[junit4:junit4] 2> 578354 T1733 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 578355 T1733 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 578355 T1733 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 578355 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 578356 T1733 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 578356 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 578357 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 578357 T1733 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 578357 T1733 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 578358 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 578369 T1733 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 578370 T1733 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25950/solr
[junit4:junit4] 2> 578370 T1733 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 578374 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 578379 T1753 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6984c9bc name:ZooKeeperConnection Watcher:127.0.0.1:25950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 578379 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 578394 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 578415 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 578420 T1755 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@110a9999 name:ZooKeeperConnection Watcher:127.0.0.1:25950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 578420 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 578434 T1733 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 578438 T1733 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 578441 T1733 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 578450 T1733 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:12626_s_kra
[junit4:junit4] 2> 578451 T1733 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:12626_s_kra
[junit4:junit4] 2> 578458 T1733 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 578472 T1733 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 578474 T1733 oasc.Overseer.start Overseer (id=89701433655361539-127.0.0.1:12626_s_kra-n_0000000000) starting
[junit4:junit4] 2> 578489 T1733 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 578493 T1757 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 578493 T1733 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 578496 T1733 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 578503 T1733 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 578505 T1756 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 578507 T1733 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 578508 T1733 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 578508 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 578517 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 578518 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 578520 T1760 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bc58f02 name:ZooKeeperConnection Watcher:127.0.0.1:25950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 578520 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 578522 T1733 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 578524 T1733 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 578670 T1733 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 578673 T1733 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:47524
[junit4:junit4] 2> 578673 T1733 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 578674 T1733 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 578674 T1733 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886
[junit4:junit4] 2> 578674 T1733 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/solr.xml
[junit4:junit4] 2> 578675 T1733 oasc.CoreContainer.<init> New CoreContainer 1701384984
[junit4:junit4] 2> 578675 T1733 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/'
[junit4:junit4] 2> 578676 T1733 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/'
[junit4:junit4] 2> 578744 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886
[junit4:junit4] 2> 578745 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/collection1
[junit4:junit4] 2> 578746 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/collection1/lib
[junit4:junit4] 2> 578747 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/collection1/lib/classes
[junit4:junit4] 2> 578748 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/collection1/conf
[junit4:junit4] 2> 578757 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/collection1/conf/xslt
[junit4:junit4] 2> 578843 T1733 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/conf/core.properties, adding to cores
[junit4:junit4] 2> 578851 T1733 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 578852 T1733 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 578853 T1733 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 578853 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 578854 T1733 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 578854 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 578855 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 578855 T1733 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 578856 T1733 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 578857 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 578869 T1733 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 578870 T1733 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25950/solr
[junit4:junit4] 2> 578870 T1733 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 578871 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 578874 T1771 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59068910 name:ZooKeeperConnection Watcher:127.0.0.1:25950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 578874 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 578887 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 578897 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 578899 T1773 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@393a9a18 name:ZooKeeperConnection Watcher:127.0.0.1:25950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 578900 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 578906 T1733 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 579910 T1733 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47524_s_kra
[junit4:junit4] 2> 579938 T1733 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47524_s_kra
[junit4:junit4] 2> 579942 T1760 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 579942 T1773 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 579942 T1755 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 579957 T1733 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 579958 T1733 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 579958 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 580188 T1733 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 580191 T1733 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45555
[junit4:junit4] 2> 580192 T1733 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 580192 T1733 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 580192 T1733 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333
[junit4:junit4] 2> 580193 T1733 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/solr.xml
[junit4:junit4] 2> 580193 T1733 oasc.CoreContainer.<init> New CoreContainer 1295028367
[junit4:junit4] 2> 580194 T1733 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/'
[junit4:junit4] 2> 580194 T1733 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/'
[junit4:junit4] 2> 580292 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333
[junit4:junit4] 2> 580295 T1733 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/conf/core.properties, adding to cores
[junit4:junit4] 2> 580299 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/collection1
[junit4:junit4] 2> 580299 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/collection1/conf
[junit4:junit4] 2> 580401 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/collection1/conf/xslt
[junit4:junit4] 2> 580405 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/collection1/lib
[junit4:junit4] 2> 580406 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/collection1/lib/classes
[junit4:junit4] 2> 580410 T1733 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 580411 T1733 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 580411 T1733 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 580411 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 580412 T1733 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 580412 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 580412 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 580413 T1733 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 580413 T1733 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 580413 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 580424 T1733 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 580424 T1733 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25950/solr
[junit4:junit4] 2> 580424 T1733 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 580425 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 580438 T1785 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@365f5b76 name:ZooKeeperConnection Watcher:127.0.0.1:25950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 580438 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 580441 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 580450 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 580453 T1787 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d63cdcd name:ZooKeeperConnection Watcher:127.0.0.1:25950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 580453 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 580466 T1733 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 581471 T1733 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45555_s_kra
[junit4:junit4] 2> 581479 T1733 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45555_s_kra
[junit4:junit4] 2> 581483 T1760 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 581483 T1787 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 581483 T1755 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 581483 T1773 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 581501 T1733 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 581501 T1733 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 581502 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 581731 T1733 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 581735 T1733 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51673
[junit4:junit4] 2> 581736 T1733 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 581736 T1733 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 581737 T1733 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875
[junit4:junit4] 2> 581738 T1733 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/solr.xml
[junit4:junit4] 2> 581738 T1733 oasc.CoreContainer.<init> New CoreContainer 575676262
[junit4:junit4] 2> 581739 T1733 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/'
[junit4:junit4] 2> 581739 T1733 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/'
[junit4:junit4] 2> 581863 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875
[junit4:junit4] 2> 581870 T1733 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/conf/core.properties, adding to cores
[junit4:junit4] 2> 581871 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/collection1
[junit4:junit4] 2> 581872 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/collection1/conf
[junit4:junit4] 2> 582023 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/collection1/conf/xslt
[junit4:junit4] 2> 582040 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/collection1/lib
[junit4:junit4] 2> 582042 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/collection1/lib/classes
[junit4:junit4] 2> 582050 T1733 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 582051 T1733 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 582051 T1733 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 582052 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 582052 T1733 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 582053 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 582053 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 582054 T1733 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 582054 T1733 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 582055 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 582070 T1733 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 582071 T1733 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25950/solr
[junit4:junit4] 2> 582072 T1733 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 582073 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 582076 T1799 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f54d8bb name:ZooKeeperConnection Watcher:127.0.0.1:25950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 582076 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 582080 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 582092 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 582094 T1801 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d9a3f2e name:ZooKeeperConnection Watcher:127.0.0.1:25950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 582094 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 582100 T1733 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 583104 T1733 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51673_s_kra
[junit4:junit4] 2> 583107 T1733 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51673_s_kra
[junit4:junit4] 2> 583110 T1755 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 583110 T1773 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 583111 T1801 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 583111 T1760 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 583110 T1787 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 583115 T1733 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 583116 T1733 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 583116 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 583272 T1733 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 583274 T1733 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:44274
[junit4:junit4] 2> 583275 T1733 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 583275 T1733 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 583276 T1733 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486
[junit4:junit4] 2> 583276 T1733 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/solr.xml
[junit4:junit4] 2> 583276 T1733 oasc.CoreContainer.<init> New CoreContainer 526378498
[junit4:junit4] 2> 583277 T1733 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/'
[junit4:junit4] 2> 583277 T1733 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/'
[junit4:junit4] 2> 583345 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486
[junit4:junit4] 2> 583347 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/collection1
[junit4:junit4] 2> 583348 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/collection1/conf
[junit4:junit4] 2> 583406 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/collection1/conf/xslt
[junit4:junit4] 2> 583441 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/collection1/lib
[junit4:junit4] 2> 583442 T1733 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/collection1/lib/classes
[junit4:junit4] 2> 583447 T1733 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/conf/core.properties, adding to cores
[junit4:junit4] 2> 583451 T1733 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 583451 T1733 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 583451 T1733 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 583452 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 583452 T1733 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 583453 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 583453 T1733 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 583453 T1733 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 583454 T1733 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 583454 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 583464 T1733 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 583464 T1733 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25950/solr
[junit4:junit4] 2> 583465 T1733 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 583466 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 583468 T1813 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a23bfee name:ZooKeeperConnection Watcher:127.0.0.1:25950 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 583468 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 583471 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 583480 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 583482 T1815 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bb835a1 name:ZooKeeperConnection Watcher:127.0.0.1:25950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 583482 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 583492 T1733 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 584495 T1733 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44274_s_kra
[junit4:junit4] 2> 584521 T1733 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44274_s_kra
[junit4:junit4] 2> 584525 T1760 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 584525 T1773 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 584525 T1787 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 584525 T1815 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 584525 T1755 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 584525 T1801 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 584540 T1733 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 584541 T1733 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 584541 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 584558 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 584574 T1763 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 584576 T1755 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 584578 T1757 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "maxShardsPerNode":null,
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"nodes_used_collection",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 584579 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:45555_s_kra
[junit4:junit4] 2> 584579 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:12626_s_kra
[junit4:junit4] 2> 584580 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:47524_s_kra
[junit4:junit4] 2> 584581 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:44274_s_kra
[junit4:junit4] 2> 584582 T1777 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 584582 T1777 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 584582 T1745 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 584583 T1745 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 584582 T1764 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 584583 T1764 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 584583 T1805 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 584583 T1777 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 584584 T1805 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 584584 T1764 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 584583 T1745 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 584586 T1805 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 584586 T1764 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 584585 T1777 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 584587 T1805 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 584586 T1745 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 584588 T1777 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 584587 T1764 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 584589 T1805 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 584588 T1777 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 584589 T1805 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 584589 T1745 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 584589 T1764 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 584591 T1745 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 584592 T1777 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 584593 T1805 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 584602 T1764 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 584603 T1745 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 584604 T1777 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/nodes_used_collection_shard1_replica1/'
[junit4:junit4] 2> 584604 T1764 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/nodes_used_collection_shard2_replica1/'
[junit4:junit4] 2> 584605 T1745 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/'
[junit4:junit4] 2> 584605 T1805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/'
[junit4:junit4] 2> 584679 T1745 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 584687 T1805 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 584687 T1777 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 584704 T1764 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 584754 T1745 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 584766 T1805 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 584772 T1777 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 584807 T1764 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 584856 T1745 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 584863 T1745 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4:junit4] 2> 584868 T1805 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 584873 T1805 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4:junit4] 2> 584874 T1777 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 584881 T1777 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4:junit4] 2> 584909 T1764 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 584920 T1764 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4:junit4] 2> 585552 T1777 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 585561 T1777 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 585565 T1777 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 585578 T1777 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 585582 T1777 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 585587 T1777 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 585588 T1777 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 585589 T1777 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 585589 T1745 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 585589 T1777 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 585590 T1777 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 585591 T1777 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 585591 T1777 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 585592 T1777 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/nodes_used_collection_shard1_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/nodes_used_collection_shard1_replica1/data/
[junit4:junit4] 2> 585592 T1777 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@468df4ff
[junit4:junit4] 2> 585592 T1777 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 585593 T1777 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/nodes_used_collection_shard1_replica1/data
[junit4:junit4] 2> 585594 T1777 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/nodes_used_collection_shard1_replica1/data/index/
[junit4:junit4] 2> 585594 T1777 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 585595 T1777 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/nodes_used_collection_shard1_replica1/data/index
[junit4:junit4] 2> 585597 T1745 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 585598 T1777 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7996599b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e5254bc),segFN=segments_1,generation=1}
[junit4:junit4] 2> 585598 T1777 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 585601 T1777 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 585601 T1777 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 585602 T1777 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 585602 T1777 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 585603 T1745 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 585603 T1777 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 585604 T1777 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 585604 T1777 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 585604 T1777 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 585605 T1777 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 585616 T1777 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 585620 T1777 oass.SolrIndexSearcher.<init> Opening Searcher@54471dfc main
[junit4:junit4] 2> 585621 T1777 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/nodes_used_collection_shard1_replica1/data/tlog
[junit4:junit4] 2> 585623 T1777 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 585623 T1745 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 585623 T1777 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 585628 T1821 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@54471dfc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 585629 T1777 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4] 2> 585644 T1764 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 585645 T1745 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 585645 T1805 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 585649 T1745 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 585651 T1745 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 585651 T1745 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 585652 T1745 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 585652 T1764 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 585653 T1805 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 585655 T1764 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 585656 T1805 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 585658 T1745 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 585658 T1745 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 585659 T1745 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 585659 T1745 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data/
[junit4:junit4] 2> 585659 T1745 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@468df4ff
[junit4:junit4] 2> 585660 T1745 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 585661 T1745 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data
[junit4:junit4] 2> 585661 T1745 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data/index/
[junit4:junit4] 2> 585662 T1745 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 585662 T1745 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data/index
[junit4:junit4] 2> 585666 T1745 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a9acce1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4c14fe71),segFN=segments_1,generation=1}
[junit4:junit4] 2> 585666 T1745 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 585669 T1745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 585670 T1764 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 585670 T1805 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 585670 T1745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 585672 T1745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 585672 T1745 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 585673 T1745 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 585673 T1745 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 585673 T1745 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 585674 T1745 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 585674 T1745 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 585689 T1745 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 585695 T1805 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 585695 T1745 oass.SolrIndexSearcher.<init> Opening Searcher@5101fe1a main
[junit4:junit4] 2> 585695 T1764 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 585696 T1745 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data/tlog
[junit4:junit4] 2> 585698 T1745 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 585698 T1745 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 585700 T1764 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 585701 T1822 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@5101fe1a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 585701 T1805 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 585701 T1764 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 585702 T1764 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 585702 T1764 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 585703 T1805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 585703 T1745 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4] 2> 585703 T1805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 585703 T1764 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 585704 T1764 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 585704 T1805 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 585705 T1764 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 585705 T1764 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/nodes_used_collection_shard2_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/nodes_used_collection_shard2_replica1/data/
[junit4:junit4] 2> 585706 T1764 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@468df4ff
[junit4:junit4] 2> 585706 T1805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 585706 T1764 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 585706 T1805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 585707 T1764 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/nodes_used_collection_shard2_replica1/data
[junit4:junit4] 2> 585707 T1805 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 585708 T1764 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/nodes_used_collection_shard2_replica1/data/index/
[junit4:junit4] 2> 585708 T1805 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data/
[junit4:junit4] 2> 585708 T1764 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 585709 T1805 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@468df4ff
[junit4:junit4] 2> 585709 T1764 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/nodes_used_collection_shard2_replica1/data/index
[junit4:junit4] 2> 585710 T1805 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 585711 T1805 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data
[junit4:junit4] 2> 585711 T1805 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data/index/
[junit4:junit4] 2> 585712 T1805 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 585713 T1805 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data/index
[junit4:junit4] 2> 585713 T1764 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@52fce40c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4de1ed4),segFN=segments_1,generation=1}
[junit4:junit4] 2> 585713 T1764 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 585716 T1764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 585716 T1764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 585717 T1764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 585717 T1805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@62e23a6d lockFactory=org.apache.lucene.store.NativeFSLockFactory@24611a8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 585717 T1764 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 585718 T1805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 585718 T1764 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 585719 T1764 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 585719 T1764 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 585720 T1764 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 585720 T1764 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 585721 T1805 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 585722 T1805 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 585723 T1805 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 585724 T1805 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 585724 T1805 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 585725 T1805 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 585725 T1805 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 585726 T1805 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 585727 T1805 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 585729 T1764 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 585729 T1805 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 585734 T1764 oass.SolrIndexSearcher.<init> Opening Searcher@315b6aad main
[junit4:junit4] 2> 585735 T1805 oass.SolrIndexSearcher.<init> Opening Searcher@16f3d8ae main
[junit4:junit4] 2> 585735 T1764 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/nodes_used_collection_shard2_replica1/data/tlog
[junit4:junit4] 2> 585735 T1805 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data/tlog
[junit4:junit4] 2> 585736 T1764 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 585737 T1764 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 585737 T1805 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 585737 T1805 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 585739 T1823 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@315b6aad main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 585740 T1824 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@16f3d8ae main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 585741 T1764 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4] 2> 585742 T1805 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4] 2> 586025 T1756 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 586025 T1756 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45555_s_kra",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45555/s_kra"}
[junit4:junit4] 2> 586026 T1756 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4:junit4] 2> 586029 T1756 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12626_s_kra",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12626/s_kra"}
[junit4:junit4] 2> 586033 T1756 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47524_s_kra",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47524/s_kra"}
[junit4:junit4] 2> 586151 T1756 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44274_s_kra",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44274/s_kra"}
[junit4:junit4] 2> 586198 T1760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 586198 T1815 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 586198 T1755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 586198 T1787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 586198 T1773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 586198 T1801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 586633 T1777 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 586633 T1777 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:45555/s_kra collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 586635 T1777 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4] 2> 586662 T1777 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 586665 T1777 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179999
[junit4:junit4] 2> 586706 T1745 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 586706 T1745 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:12626/s_kra collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 586744 T1805 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 586744 T1764 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 586744 T1805 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:44274/s_kra collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 586745 T1764 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:47524/s_kra collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 586746 T1805 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4] 2> 586746 T1764 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4] 2> 586753 T1764 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 586757 T1764 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 586757 T1764 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 586757 T1764 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47524/s_kra/nodes_used_collection_shard2_replica1/
[junit4:junit4] 2> 586758 T1764 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:47524/s_kra START replicas=[http://127.0.0.1:44274/s_kra/nodes_used_collection_shard2_replica2/] nUpdates=100
[junit4:junit4] 2> 586759 T1764 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:47524/s_kra DONE. We have no versions. sync failed.
[junit4:junit4] 2> 586759 T1764 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 586760 T1764 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 586760 T1764 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47524/s_kra/nodes_used_collection_shard2_replica1/
[junit4:junit4] 2> 586761 T1764 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4] 2> ASYNC NEW_CORE C84 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@55e785bb url=http://127.0.0.1:44274/s_kra/nodes_used_collection_shard2_replica2 node=127.0.0.1:44274_s_kra C84_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=down, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:44274_s_kra, base_url=http://127.0.0.1:44274/s_kra}
[junit4:junit4] 2> 586769 T1806 C84 P44274 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/s_kra path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 587166 T1777 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 587167 T1777 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 587168 T1777 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45555/s_kra/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 587168 T1777 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:45555/s_kra START replicas=[http://127.0.0.1:12626/s_kra/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4:junit4] 2> 587169 T1777 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:45555/s_kra DONE. We have no versions. sync failed.
[junit4:junit4] 2> 587169 T1777 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 587170 T1777 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 587170 T1777 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45555/s_kra/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 587171 T1777 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C85 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@524031fd url=http://127.0.0.1:12626/s_kra/nodes_used_collection_shard1_replica2 node=127.0.0.1:12626_s_kra C85_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:12626_s_kra, base_url=http://127.0.0.1:12626/s_kra}
[junit4:junit4] 2> 587175 T1746 C85 P12626 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/s_kra path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 587774 T1756 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 587824 T1760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 587824 T1801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 587824 T1815 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 587824 T1787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 587824 T1773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 587824 T1755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 587840 T1764 oasc.ZkController.register We are http://127.0.0.1:47524/s_kra/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:47524/s_kra/nodes_used_collection_shard2_replica1/
[junit4:junit4] 2> 587840 T1764 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:47524/s_kra
[junit4:junit4] 2> 587841 T1764 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 587841 T1764 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=active
[junit4:junit4] 2> 587843 T1764 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 587844 T1764 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3262
[junit4:junit4] 2> 587857 T1805 oasc.ZkController.register We are http://127.0.0.1:44274/s_kra/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:47524/s_kra/nodes_used_collection_shard2_replica1/
[junit4:junit4] 2> 587857 T1805 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:44274/s_kra
[junit4:junit4] 2> 587858 T1805 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 587858 T1805 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 587859 T1827 C84 P44274 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard2_replica2 recoveringAfterStartup=true
[junit4:junit4] 2> 587859 T1827 C84 P44274 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 587859 T1805 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 587860 T1827 C84 P44274 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=recovering
[junit4:junit4] 2> 587861 T1805 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3278
[junit4:junit4] 2> 587864 T1827 C84 P44274 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 587864 T1745 oasc.ZkController.register We are http://127.0.0.1:12626/s_kra/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:45555/s_kra/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 587864 T1745 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:12626/s_kra
[junit4:junit4] 2> 587865 T1745 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 587865 T1745 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 587866 T1828 C85 P12626 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard1_replica2 recoveringAfterStartup=true
[junit4:junit4] 2> 587866 T1828 C85 P12626 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 587866 T1745 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 587867 T1828 C85 P12626 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=recovering
[junit4:junit4] 2> 587868 T1745 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3286
[junit4:junit4] 2> 587869 T1828 C85 P12626 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 587877 T1777 oasc.ZkController.register We are http://127.0.0.1:45555/s_kra/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:45555/s_kra/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 587877 T1777 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:45555/s_kra
[junit4:junit4] 2> 587878 T1777 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 587878 T1777 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=active
[junit4:junit4] 2> 587880 T1777 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 587881 T1777 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3299
[junit4:junit4] 2> 587882 T1765 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:44274_s_kra_nodes_used_collection_shard2_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 587882 T1757 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4:junit4] 2> 587882 T1778 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:12626_s_kra_nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 587897 T1773 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4] 2> 587899 T1755 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 587899 T1757 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=3262},core=nodes_used_collection_shard2_replica1},null={responseHeader={status=0,QTime=3278},core=nodes_used_collection_shard2_replica2},null={responseHeader={status=0,QTime=3286},core=nodes_used_collection_shard1_replica2},null={responseHeader={status=0,QTime=3299},core=nodes_used_collection_shard1_replica1}}}
[junit4:junit4] 2> 587910 T1763 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=3340
[junit4:junit4] 2> 587911 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 587912 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 587914 T1830 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ee864d8 name:ZooKeeperConnection Watcher:127.0.0.1:25950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 587915 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 587917 T1733 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 587920 T1733 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 587921 T1733 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 587924 T1832 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65a1553a name:ZooKeeperConnection Watcher:127.0.0.1:25950/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 587924 T1733 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 587925 T1733 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 587939 T1779 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=5&maxShardsPerNode=6&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 587941 T1755 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 587943 T1757 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"5",
[junit4:junit4] 2> "maxShardsPerNode":"6",
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"awholynewcollection_0",
[junit4:junit4] 2> "replicationFactor":"5"}
[junit4:junit4] 2> 587944 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:45555_s_kra
[junit4:junit4] 2> 587944 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:51673_s_kra
[junit4:junit4] 2> 587944 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica3 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:47524_s_kra
[junit4:junit4] 2> 587945 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica4 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:44274_s_kra
[junit4:junit4] 2> 587945 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica5 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:12626_s_kra
[junit4:junit4] 2> 587946 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica1 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:45555_s_kra
[junit4:junit4] 2> 587946 T1791 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard1_replica2
[junit4:junit4] 2> 587946 T1777 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/awholynewcollection_0_shard1_replica1
[junit4:junit4] 2> 587947 T1805 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica4' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/awholynewcollection_0_shard1_replica4
[junit4:junit4] 2> 587946 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica2 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:51673_s_kra
[junit4:junit4] 2> 587948 T1805 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587948 T1780 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/awholynewcollection_0_shard2_replica1
[junit4:junit4] 2> 587948 T1764 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica3' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/awholynewcollection_0_shard1_replica3
[junit4:junit4] 2> 587949 T1805 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 587947 T1777 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587947 T1791 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587951 T1777 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 587952 T1791 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 587950 T1805 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 587950 T1764 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587949 T1792 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard2_replica2
[junit4:junit4] 2> 587949 T1780 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587948 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica3 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:47524_s_kra
[junit4:junit4] 2> 587948 T1745 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica5' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/awholynewcollection_0_shard1_replica5
[junit4:junit4] 2> 587955 T1745 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587955 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica4 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:44274_s_kra
[junit4:junit4] 2> 587955 T1780 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 587956 T1766 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica3' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/awholynewcollection_0_shard2_replica3
[junit4:junit4] 2> 587957 T1766 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587954 T1805 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 587954 T1764 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 587954 T1792 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587953 T1791 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 587952 T1777 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 587959 T1792 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 587958 T1764 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 587958 T1805 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 587958 T1766 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 587961 T1764 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 587957 T1807 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica4' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/awholynewcollection_0_shard2_replica4
[junit4:junit4] 2> 587962 T1807 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587956 T1780 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 587956 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica5 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:12626_s_kra
[junit4:junit4] 2> 587956 T1745 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 587963 T1807 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 587963 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica1 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:45555_s_kra
[junit4:junit4] 2> 587961 T1764 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 587961 T1766 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 587960 T1777 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 587960 T1791 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 587960 T1792 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 587966 T1791 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 587966 T1777 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 587967 T1764 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587965 T1781 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/awholynewcollection_0_shard3_replica1
[junit4:junit4] 2> 587965 T1747 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica5' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/awholynewcollection_0_shard2_replica5
[junit4:junit4] 2> 587964 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica2 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:51673_s_kra
[junit4:junit4] 2> 587964 T1780 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 587964 T1807 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587963 T1805 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587963 T1745 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 587970 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica3 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:47524_s_kra
[junit4:junit4] 2> 587969 T1747 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587969 T1791 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587969 T1781 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587968 T1792 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 587967 T1766 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 587973 T1767 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica3' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/awholynewcollection_0_shard3_replica3
[junit4:junit4] 2> 587971 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica4 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:44274_s_kra
[junit4:junit4] 2> 587971 T1793 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard3_replica2
[junit4:junit4] 2> 587974 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica5 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:12626_s_kra
[junit4:junit4] 2> 587974 T1767 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587975 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica1 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:45555_s_kra
[junit4:junit4] 2> 587974 T1793 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587976 T1808 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica4' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/awholynewcollection_0_shard3_replica4
[junit4:junit4] 2> 587976 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica2 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:51673_s_kra
[junit4:junit4] 2> 587976 T1808 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587976 T1748 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica5' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/awholynewcollection_0_shard3_replica5
[junit4:junit4] 2> 587978 T1781 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 587978 T1793 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 587978 T1794 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard4_replica2
[junit4:junit4] 2> 587979 T1794 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587978 T1764 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/awholynewcollection_0_shard1_replica3/'
[junit4:junit4] 2> 587980 T1766 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587978 T1767 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 587978 T1748 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587978 T1747 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 587977 T1777 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587977 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica3 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:47524_s_kra
[junit4:junit4] 2> 587977 T1782 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/awholynewcollection_0_shard4_replica1
[junit4:junit4] 2> 587983 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica4 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:44274_s_kra
[junit4:junit4] 2> 587983 T1766 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/awholynewcollection_0_shard2_replica3/'
[junit4:junit4] 2> 587982 T1748 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 587982 T1747 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587981 T1767 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587981 T1794 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 587981 T1792 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587980 T1805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/awholynewcollection_0_shard1_replica4/'
[junit4:junit4] 2> 587980 T1807 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/awholynewcollection_0_shard2_replica4/'
[junit4:junit4] 2> 587980 T1791 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard1_replica2/'
[junit4:junit4] 2> 587980 T1780 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587979 T1793 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587989 T1792 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard2_replica2/'
[junit4:junit4] 2> 587979 T1745 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 587979 T1808 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 587978 T1781 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587990 T1808 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587991 T1793 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard3_replica2/'
[junit4:junit4] 2> 587987 T1767 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/awholynewcollection_0_shard3_replica3/'
[junit4:junit4] 2> 587987 T1747 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/awholynewcollection_0_shard2_replica5/'
[junit4:junit4] 2> 587986 T1794 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587985 T1809 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica4' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/awholynewcollection_0_shard4_replica4
[junit4:junit4] 2> 587985 T1768 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica3' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/awholynewcollection_0_shard4_replica3
[junit4:junit4] 2> 587985 T1748 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587984 T1777 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/awholynewcollection_0_shard1_replica1/'
[junit4:junit4] 2> 587983 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica5 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:12626_s_kra
[junit4:junit4] 2> 587983 T1782 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587995 T1794 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard4_replica2/'
[junit4:junit4] 2> 587995 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica1 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:45555_s_kra
[junit4:junit4] 2> 587997 T1748 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/awholynewcollection_0_shard3_replica5/'
[junit4:junit4] 2> 587994 T1768 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587994 T1808 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/awholynewcollection_0_shard3_replica4/'
[junit4:junit4] 2> 587998 T1783 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/awholynewcollection_0_shard5_replica1
[junit4:junit4] 2> 587993 T1809 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587993 T1781 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/awholynewcollection_0_shard3_replica1/'
[junit4:junit4] 2> 587992 T1745 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 587991 T1780 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/awholynewcollection_0_shard2_replica1/'
[junit4:junit4] 2> 588000 T1809 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 587999 T1783 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 587998 T1768 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 587997 T1749 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica5' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/awholynewcollection_0_shard4_replica5
[junit4:junit4] 2> 588002 T1745 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/awholynewcollection_0_shard1_replica5/'
[junit4:junit4] 2> 587997 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica2 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:51673_s_kra
[junit4:junit4] 2> 587996 T1782 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 588003 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica3 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:47524_s_kra
[junit4:junit4] 2> 588002 T1749 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 588002 T1783 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 588002 T1768 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 588001 T1809 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 588005 T1749 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 588005 T1783 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 588005 T1795 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard5_replica2
[junit4:junit4] 2> 588007 T1795 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 588004 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica4 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:44274_s_kra
[junit4:junit4] 2> 588004 T1782 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 588008 T1795 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 588009 T1795 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 588008 T1757 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica5 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:12626_s_kra
[junit4:junit4] 2> 588006 T1749 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 588006 T1769 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica3' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/awholynewcollection_0_shard5_replica3
[junit4:junit4] 2> 588011 T1750 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica5' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/awholynewcollection_0_shard5_replica5
[junit4:junit4] 2> 588012 T1782 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/awholynewcollection_0_shard4_replica1/'
[junit4:junit4] 2> 588012 T1769 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 588011 T1795 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard5_replica2/'
[junit4:junit4] 2> 588014 T1769 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 588010 T1810 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica4' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/awholynewcollection_0_shard5_replica4
[junit4:junit4] 2> 588009 T1783 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368735257333/awholynewcollection_0_shard5_replica1/'
[junit4:junit4] 2> 588008 T1809 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/awholynewcollection_0_shard4_replica4/'
[junit4:junit4] 2> 588008 T1768 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/awholynewcollection_0_shard4_replica3/'
[junit4:junit4] 2> 588015 T1810 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 588014 T1769 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 588013 T1749 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/awholynewcollection_0_shard4_replica5/'
[junit4:junit4] 2> 588012 T1750 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 588018 T1810 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 588019 T1810 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 588019 T1750 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 588020 T1769 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368735255886/awholynewcollection_0_shard5_replica3/'
[junit4:junit4] 2> 588020 T1750 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 588022 T1810 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/awholynewcollection_0_shard5_replica4/'
[junit4:junit4] 2> 588023 T1750 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/awholynewcollection_0_shard5_replica5/'
[junit4:junit4] 2> 588115 T1764 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588120 T1792 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588124 T1747 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588127 T1805 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588136 T1766 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588155 T1791 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588156 T1807 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588164 T1795 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588165 T1782 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588200 T1767 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588211 T1809 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588219 T1793 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588246 T1777 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588295 T1750 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588301 T1748 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588303 T1794 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588306 T1745 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588310 T1810 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588327 T1808 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588332 T1781 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588359 T1780 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588391 T1783 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588393 T1769 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588414 T1749 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588418 T1747 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588421 T1764 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588425 T1747 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588425 T1768 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 588444 T1747 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica5] Schema name=test
[junit4:junit4] 2> 588447 T1805 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588450 T1805 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588458 T1791 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588473 T1805 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica4] Schema name=test
[junit4:junit4] 2> 588477 T1766 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588479 T1764 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588480 T1766 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588485 T1792 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588486 T1791 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588489 T1792 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588508 T1766 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica3] Schema name=test
[junit4:junit4] 2> 588508 T1764 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica3] Schema name=test
[junit4:junit4] 2> 588510 T1791 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4:junit4] 2> 588510 T1792 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica2] Schema name=test
[junit4:junit4] 2> 588512 T1795 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588515 T1795 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588537 T1782 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588546 T1807 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588547 T1809 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588550 T1767 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588550 T1809 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588550 T1795 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica2] Schema name=test
[junit4:junit4] 2> 588551 T1807 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588553 T1767 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588565 T1809 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica4] Schema name=test
[junit4:junit4] 2> 588575 T1767 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica3] Schema name=test
[junit4:junit4] 2> 588586 T1807 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica4] Schema name=test
[junit4:junit4] 2> 588590 T1793 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588595 T1793 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588611 T1793 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica2] Schema name=test
[junit4:junit4] 2> 588635 T1777 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588637 T1782 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588638 T1777 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588649 T1810 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588652 T1810 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588654 T1777 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica1] Schema name=test
[junit4:junit4] 2> 588682 T1782 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica1] Schema name=test
[junit4:junit4] 2> 588682 T1810 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica4] Schema name=test
[junit4:junit4] 2> 588717 T1808 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588718 T1794 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588722 T1794 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588724 T1768 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588726 T1808 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588727 T1749 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588727 T1750 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588728 T1768 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588730 T1748 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588732 T1749 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588735 T1750 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588736 T1748 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588742 T1808 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica4] Schema name=test
[junit4:junit4] 2> 588742 T1794 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica2] Schema name=test
[junit4:junit4] 2> 588745 T1768 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica3] Schema name=test
[junit4:junit4] 2> 588747 T1745 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588752 T1745 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588753 T1748 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica5] Schema name=test
[junit4:junit4] 2> 588756 T1749 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica5] Schema name=test
[junit4:junit4] 2> 588758 T1750 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica5] Schema name=test
[junit4:junit4] 2> 588764 T1781 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588767 T1745 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica5] Schema name=test
[junit4:junit4] 2> 588768 T1781 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588788 T1781 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica1] Schema name=test
[junit4:junit4] 2> 588792 T1780 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588795 T1780 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588808 T1780 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica1] Schema name=test
[junit4:junit4] 2> 588896 T1769 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588904 T1769 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588908 T1783 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 588912 T1783 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 588914 T1769 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica3] Schema name=test
[junit4:junit4] 2> 588933 T1783 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica1] Schema name=test
[junit4:junit4] 2> 589363 T1756 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 589365 T1756 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47524_s_kra_nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47524_s_kra",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47524/s_kra"}
[junit4:junit4] 2> 589377 T1756 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:44274_s_kra_nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44274_s_kra",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44274/s_kra"}
[junit4:junit4] 2> 589386 T1756 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:12626_s_kra_nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12626_s_kra",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12626/s_kra"}
[junit4:junit4] 2> 589402 T1756 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:45555_s_kra_nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45555_s_kra",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45555/s_kra"}
[junit4:junit4] 2> 589415 T1787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 589415 T1773 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 589416 T1801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 589416 T1815 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 589416 T1830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 589415 T1832 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 589415 T1755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 589415 T1760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 589884 T1765 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:44274_s_kra_nodes_used_collection_shard2_replica2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 589885 T1765 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:44274_s_kra_nodes_used_collection_shard2_replica2&state=recovering&nodeName=127.0.0.1:44274_s_kra&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 589886 T1778 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:12626_s_kra_nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 589886 T1778 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:12626_s_kra_nodes_used_collection_shard1_replica2&state=recovering&nodeName=127.0.0.1:12626_s_kra&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2004
[junit4:junit4] 2> C84_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:44274_s_kra, base_url=http://127.0.0.1:44274/s_kra}
[junit4:junit4] 2> 591887 T1827 C84 P44274 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:47524/s_kra/nodes_used_collection_shard2_replica1/ core=nodes_used_collection_shard2_replica2 - recoveringAfterStartup=true
[junit4:junit4] 2> 591887 T1827 C84 P44274 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:44274/s_kra START replicas=[http://127.0.0.1:47524/s_kra/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4] 2> C85_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:12626_s_kra, base_url=http://127.0.0.1:12626/s_kra}
[junit4:junit4] 2> 591888 T1828 C85 P12626 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45555/s_kra/nodes_used_collection_shard1_replica1/ core=nodes_used_collection_shard1_replica2 - recoveringAfterStartup=true
[junit4:junit4] 2> 591888 T1827 C84 P44274 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 591888 T1827 C84 P44274 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 591888 T1827 C84 P44274 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 591889 T1827 C84 P44274 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 591888 T1828 C85 P12626 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:12626/s_kra START replicas=[http://127.0.0.1:45555/s_kra/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4:junit4] 2> 591889 T1827 C84 P44274 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 591890 T1828 C85 P12626 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 591890 T1827 C84 P44274 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:47524/s_kra/nodes_used_collection_shard2_replica1/. core=nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 591890 T1828 C85 P12626 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 591890 T1827 C84 P44274 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 591890 T1828 C85 P12626 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 591891 T1828 C85 P12626 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 591891 T1828 C85 P12626 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 591892 T1828 C85 P12626 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45555/s_kra/nodes_used_collection_shard1_replica1/. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 591892 T1828 C85 P12626 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 591907 T1795 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 591936 T1795 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> ASYNC NEW_CORE C86 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@32295269 url=http://127.0.0.1:47524/s_kra/nodes_used_collection_shard2_replica1 node=127.0.0.1:47524_s_kra C86_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:47524_s_kra, base_url=http://127.0.0.1:47524/s_kra, leader=true}
[junit4:junit4] 2> 591942 T1763 C86 P47524 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/s_kra path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=3
[junit4:junit4] 2> ASYNC NEW_CORE C87 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@69a40dc3 url=http://127.0.0.1:45555/s_kra/nodes_used_collection_shard1_replica1 node=127.0.0.1:45555_s_kra C87_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:45555_s_kra, base_url=http://127.0.0.1:45555/s_kra, leader=true}
[junit4:junit4] 2> 591962 T1778 C87 P45555 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/s_kra path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 591962 T1765 C86 P47524 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 591968 T1765 C86 P47524 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@52fce40c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4de1ed4),segFN=segments_1,generation=1}
[junit4:junit4] 2> 591970 T1765 C86 P47524 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 591971 T1765 C86 P47524 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@52fce40c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4de1ed4),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@52fce40c lockFactory=org.apache.lucene.store.NativeFSLockFactory@4de1ed4),segFN=segments_2,generation=2}
[junit4:junit4] 2> 591973 T1765 C86 P47524 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 591974 T1765 C86 P47524 oass.SolrIndexSearcher.<init> Opening Searcher@77ebb9ba realtime
[junit4:junit4] 2> 591974 T1765 C86 P47524 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 591975 T1765 C86 P47524 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard2_replica1] webapp=/s_kra path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 591972 T1795 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 591977 T1827 C84 P44274 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 591977 T1827 C84 P44274 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 591980 T1856 C87 P45555 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 591980 T1765 C86 P47524 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 591982 T1765 C86 P47524 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/s_kra path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4] 2> 591983 T1827 C84 P44274 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 591983 T1827 C84 P44274 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 591984 T1827 C84 P44274 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 591984 T1856 C87 P45555 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7996599b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e5254bc),segFN=segments_1,generation=1}
[junit4:junit4] 2> 591987 T1856 C87 P45555 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 591988 T1856 C87 P45555 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7996599b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e5254bc),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7996599b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e5254bc),segFN=segments_2,generation=2}
[junit4:junit4] 2> 591988 T1765 C86 P47524 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/s_kra path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 591989 T1856 C87 P45555 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 591989 T1827 C84 P44274 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 591990 T1856 C87 P45555 oass.SolrIndexSearcher.<init> Opening Searcher@392e3368 realtime
[junit4:junit4] 2> 591991 T1856 C87 P45555 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 591991 T1856 C87 P45555 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard1_replica1] webapp=/s_kra path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 11
[junit4:junit4] 2> 591992 T1827 C84 P44274 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data/index.20130516201429352
[junit4:junit4] 2> 591993 T1827 C84 P44274 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@6d4026fa lockFactory=org.apache.lucene.store.NativeFSLockFactory@24d3e465) fullCopy=false
[junit4:junit4] 2> 591993 T1828 C85 P12626 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 591994 T1828 C85 P12626 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 591997 T1857 C87 P45555 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 591998 T1765 C86 P47524 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/s_kra path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 591998 T1857 C87 P45555 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/s_kra path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 592000 T1828 C85 P12626 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 592000 T1828 C85 P12626 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 592001 T1827 C84 P44274 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 592001 T1828 C85 P12626 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 592003 T1827 C84 P44274 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 592003 T1827 C84 P44274 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 592005 T1857 C87 P45555 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/s_kra path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 592006 T1828 C85 P12626 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 592008 T1828 C85 P12626 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data/index.20130516201429369
[junit4:junit4] 2> 592008 T1828 C85 P12626 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b665821 lockFactory=org.apache.lucene.store.NativeFSLockFactory@43e25b09) fullCopy=false
[junit4:junit4] 2> 592008 T1827 C84 P44274 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@62e23a6d lockFactory=org.apache.lucene.store.NativeFSLockFactory@24611a8),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@62e23a6d lockFactory=org.apache.lucene.store.NativeFSLockFactory@24611a8),segFN=segments_2,generation=2}
[junit4:junit4] 2> 592010 T1827 C84 P44274 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 592010 T1827 C84 P44274 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 592011 T1827 C84 P44274 oass.SolrIndexSearcher.<init> Opening Searcher@3ce947e8 main
[junit4:junit4] 2> 592012 T1857 C87 P45555 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/s_kra path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 592013 T1824 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@3ce947e8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 592014 T1827 C84 P44274 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data/index.20130516201429352 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data/index.20130516201429352;done=true>>]
[junit4:junit4] 2> 592014 T1828 C85 P12626 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 592014 T1827 C84 P44274 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data/index.20130516201429352
[junit4:junit4] 2> 592015 T1827 C84 P44274 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368735260486/nodes_used_collection_shard2_replica2/data/index.20130516201429352
[junit4:junit4] 2> 592015 T1828 C85 P12626 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 592015 T1827 C84 P44274 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 592016 T1828 C85 P12626 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 592016 T1827 C84 P44274 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 592017 T1827 C84 P44274 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4:junit4] 2> 592020 T1828 C85 P12626 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a9acce1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4c14fe71),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a9acce1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4c14fe71),segFN=segments_2,generation=2}
[junit4:junit4] 2> 592021 T1828 C85 P12626 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 592021 T1828 C85 P12626 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 592022 T1828 C85 P12626 oass.SolrIndexSearcher.<init> Opening Searcher@2a52a7cf main
[junit4:junit4] 2> 592023 T1827 C84 P44274 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 592024 T1822 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@2a52a7cf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 592024 T1828 C85 P12626 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data/index.20130516201429369 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data/index.20130516201429369;done=true>>]
[junit4:junit4] 2> 592025 T1828 C85 P12626 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data/index.20130516201429369
[junit4:junit4] 2> 592025 T1828 C85 P12626 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368735255100/nodes_used_collection_shard1_replica2/data/index.20130516201429369
[junit4:junit4] 2> 592026 T1828 C85 P12626 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 592026 T1828 C85 P12626 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 592026 T1828 C85 P12626 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=active
[junit4:junit4] 2> 592030 T1828 C85 P12626 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 592041 T1795 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592058 T1795 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592079 T1795 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 592083 T1795 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 592084 T1795 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 592084 T1795 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 592089 T1795 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 592090 T1795 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 592090 T1795 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 592091 T1795 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard5_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard5_replica2/data/
[junit4:junit4] 2> 592092 T1795 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@468df4ff
[junit4:junit4] 2> 592093 T1795 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 592094 T1795 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard5_replica2/data
[junit4:junit4] 2> 592095 T1795 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard5_replica2/data/index/
[junit4:junit4] 2> 592096 T1795 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard5_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 592097 T1795 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard5_replica2/data/index
[junit4:junit4] 2> 592116 T1795 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31db1efb lockFactory=org.apache.lucene.store.NativeFSLockFactory@66a6c898),segFN=segments_1,generation=1}
[junit4:junit4] 2> 592117 T1795 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 592125 T1795 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 592126 T1795 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 592127 T1795 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 592128 T1795 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 592129 T1795 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 592129 T1795 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 592130 T1795 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 592131 T1795 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 592132 T1795 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 592208 T1791 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592254 T1791 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592267 T1791 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592272 T1795 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 592282 T1795 oass.SolrIndexSearcher.<init> Opening Searcher@4d9b4c51 main
[junit4:junit4] 2> 592283 T1795 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368735258875/awholynewcollection_0_shard5_replica2/data/tlog
[junit4:junit4] 2> 592289 T1795 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 592290 T1795 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 592296 T1860 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard5_replica2] Registered new searcher Searcher@4d9b4c51 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 592298 T1768 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592299 T1795 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica2 state=down
[junit4:junit4] 2> 592316 T1766 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592316 T1768 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592334 T1805 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592335 T1768 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592352 T1791 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592361 T1766 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592362 T1747 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592363 T1748 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592367 T1767 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592370 T1766 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592373 T1805 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592383 T1748 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592389 T1747 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592393 T1767 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592393 T1805 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592399 T1748 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592399 T1777 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592400 T1747 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592408 T1749 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592412 T1809 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592413 T1768 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592415 T1767 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592417 T1807 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592417 T1780 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592419 T1766 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592420 T1793 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592423 T1777 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592425 T1764 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592432 T1749 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592436 T1766 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592436 T1791 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592438 T1809 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592439 T1777 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592436 T1768 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592438 T1805 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592440 T1749 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592442 T1807 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592442 T1780 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592442 T1769 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592446 T1793 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592449 T1756 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 592450 T1809 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592451 T1781 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592452 T1791 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 592453 T1756 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:44274_s_kra_nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44274_s_kra",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44274/s_kra"}
[junit4:junit4] 2> 592453 T1792 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592452 T1764 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592455 T1780 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592455 T1766 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 592455 T1807 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592457 T1768 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 592459 T1793 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592461 T1791 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 592461 T1791 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 592462 T1791 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 592461 T1750 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 592463 T1764 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 592461 T1805 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592465 T1748 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592465 T1747 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 592465 T1769 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592464 T1766 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 592464 T1768 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 592467 T1766 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 592468 T1781 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 592468 T1768 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 592468 T1766 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 592470 T1768 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 592471 T1791 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 592472 T1791 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 592473 T1791 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:jun
[...truncated too long message...]
2-127.0.0.1:47524_s_kra_awholynewcollection_1_shard2_replica3-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3 (1)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election (5)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election/89701433655361542-127.0.0.1:47524_s_kra_awholynewcollection_1_shard3_replica3-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election/89701433655361544-127.0.0.1:45555_s_kra_awholynewcollection_1_shard3_replica4-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election/89701433655361546-127.0.0.1:51673_s_kra_awholynewcollection_1_shard3_replica2-n_0000000004 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election/89701433655361548-127.0.0.1:44274_s_kra_awholynewcollection_1_shard3_replica1-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election/89701433655361539-127.0.0.1:12626_s_kra_awholynewcollection_1_shard3_replica5-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders (3)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_1_shard1_replica2",
[junit4:junit4] 1> "node_name":"127.0.0.1:51673_s_kra",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:51673/s_kra"}
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_1_shard2_replica3",
[junit4:junit4] 1> "node_name":"127.0.0.1:47524_s_kra",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47524/s_kra"}
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders/shard3 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_1_shard3_replica4",
[junit4:junit4] 1> "node_name":"127.0.0.1:45555_s_kra",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:45555/s_kra"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (5)
[junit4:junit4] 1> /solr/overseer_elect/election/89701433655361546-127.0.0.1:51673_s_kra-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89701433655361542-127.0.0.1:47524_s_kra-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89701433655361548-127.0.0.1:44274_s_kra-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89701433655361539-127.0.0.1:12626_s_kra-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89701433655361544-127.0.0.1:45555_s_kra-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89701433655361539-127.0.0.1:12626_s_kra-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=8DB8DC7356337E33 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_PY -Dtests.timezone=America/Scoresbysund -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 280s J1 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([8DB8DC7356337E33:C5E526B216C1E0F]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 857711 T1733 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 280336 T1732 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> 858730 T1815 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 858730 T1815 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 858730 T1815 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 858730 T1815 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_3/leader_elect/shard1/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=es_PY, timezone=America/Scoresbysund
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=4,free=373515320,total=536870912
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestSearchPerf, TestMaxScoreQueryParser, TestFoldingMultitermQuery, TestDFRSimilarityFactory, TestBinaryField, TestJmxMonitoredMap, StandardRequestHandlerTest, TestLMDirichletSimilarityFactory, NumericFieldsTest, TimeZoneUtilsTest, TestSolrJ, SimpleFacetsTest, TestManagedSchemaFieldResource, SpellingQueryConverterTest, TestStressLucene, DirectSolrSpellCheckerTest, MBeansHandlerTest, TestSweetSpotSimilarityFactory, SolrIndexConfigTest, MultiTermTest, TestBadConfig, TestSurroundQueryParser, TestAddFieldRealTimeGet, TestIndexingPerformance, FileBasedSpellCheckerTest, PluginInfoTest, TestDocumentBuilder, DisMaxRequestHandlerTest, TestStressReorder, QueryEqualityTest, TestDynamicFieldCollectionResource, BasicDistributedZk2Test, ShardRoutingTest, MoreLikeThisHandlerTest, TestSolrDeletionPolicy2, DefaultValueUpdateProcessorTest, TestHashPartitioner, TestSuggestSpellingConverter, CopyFieldTest, SolrCoreTest, SoftAutoCommitTest, CoreAdminHandlerTest, RegexBoostProcessorTest, TestCoreContainer, TestCodecSupport, PathHierarchyTokenizerFactoryTest, TestFastLRUCache, SolrCoreCheckLockOnStartupTest, LoggingHandlerTest, TestUpdate, HighlighterConfigTest, ZkNodePropsTest, TestReplicationHandler, TestPropInject, SearchHandlerTest, ClusterStateUpdateTest, TestFieldTypeCollectionResource, NotRequiredUniqueKeyTest, TestValueSourceCache, CollectionsAPIDistributedZkTest]
[junit4:junit4] Completed on J1 in 281.62s, 1 test, 1 failure <<< FAILURES!
[...truncated 522 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 failure, 27 ignored (8 assumptions)
Total time: 54 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1253 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1253/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:40471 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:40471 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([9743978AD944E54B:16A51992AE1B8577]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9601 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 1447559 T3408 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 1447564 T3408 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1368713861536
[junit4:junit4] 2> 1447566 T3408 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1447566 T3409 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1447667 T3408 oasc.ZkTestServer.run start zk server on port:40464
[junit4:junit4] 2> 1447668 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1447679 T3415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51004416 name:ZooKeeperConnection Watcher:127.0.0.1:40464 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1447680 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1447680 T3408 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1447696 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1447698 T3417 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c3be658 name:ZooKeeperConnection Watcher:127.0.0.1:40464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1447699 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1447699 T3408 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1447709 T3408 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1447714 T3408 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1447720 T3408 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1447724 T3408 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1447725 T3408 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1447739 T3408 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1447741 T3408 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1447846 T3408 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1447847 T3408 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1447855 T3408 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1447856 T3408 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1447863 T3408 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1447865 T3408 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1447870 T3408 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1447871 T3408 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1447875 T3408 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1447876 T3408 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1447881 T3408 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1447882 T3408 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1447888 T3408 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1447889 T3408 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1448164 T3408 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1448168 T3408 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40467
[junit4:junit4] 2> 1448169 T3408 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1448170 T3408 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1448171 T3408 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368713861864
[junit4:junit4] 2> 1448171 T3408 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368713861864/solr.xml
[junit4:junit4] 2> 1448172 T3408 oasc.CoreContainer.<init> New CoreContainer 994466752
[junit4:junit4] 2> 1448173 T3408 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368713861864/'
[junit4:junit4] 2> 1448173 T3408 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368713861864/'
[junit4:junit4] 2> 1448361 T3408 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1448362 T3408 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1448363 T3408 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1448363 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1448364 T3408 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1448365 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1448365 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1448366 T3408 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1448367 T3408 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1448368 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1448387 T3408 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1448388 T3408 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40464/solr
[junit4:junit4] 2> 1448389 T3408 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1448390 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1448393 T3428 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d57d19e name:ZooKeeperConnection Watcher:127.0.0.1:40464 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1448394 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1448397 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1448415 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1448418 T3430 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c1d3180 name:ZooKeeperConnection Watcher:127.0.0.1:40464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1448418 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1448421 T3408 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1448431 T3408 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1448436 T3408 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1448439 T3408 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40467_
[junit4:junit4] 2> 1448446 T3408 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40467_
[junit4:junit4] 2> 1448453 T3408 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1448469 T3408 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1448473 T3408 oasc.Overseer.start Overseer (id=89700031630147587-127.0.0.1:40467_-n_0000000000) starting
[junit4:junit4] 2> 1448487 T3408 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1448498 T3432 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1448500 T3408 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1448503 T3408 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1448506 T3408 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1448510 T3431 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1448515 T3433 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368713861864/collection1
[junit4:junit4] 2> 1448515 T3433 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1448516 T3433 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1448516 T3433 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1448520 T3433 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368713861864/collection1/'
[junit4:junit4] 2> 1448522 T3433 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1368713861864/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1448523 T3433 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1368713861864/collection1/lib/README' to classloader
[junit4:junit4] 2> 1448585 T3433 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1448654 T3433 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1448756 T3433 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1448763 T3433 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1449563 T3433 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1449567 T3433 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1449569 T3433 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1449577 T3433 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1449631 T3433 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1449632 T3433 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368713861864/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368713861536/control/data/
[junit4:junit4] 2> 1449632 T3433 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@524db33c
[junit4:junit4] 2> 1449633 T3433 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1449633 T3433 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/control/data
[junit4:junit4] 2> 1449634 T3433 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368713861536/control/data/index/
[junit4:junit4] 2> 1449634 T3433 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368713861536/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1449634 T3433 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/control/data/index
[junit4:junit4] 2> 1449639 T3433 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@35babddb lockFactory=org.apache.lucene.store.NativeFSLockFactory@3003a91),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1449639 T3433 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1449642 T3433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1449642 T3433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1449643 T3433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1449644 T3433 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1449645 T3433 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1449645 T3433 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1449645 T3433 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1449646 T3433 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1449647 T3433 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1449665 T3433 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1449674 T3433 oass.SolrIndexSearcher.<init> Opening Searcher@c7b24ac main
[junit4:junit4] 2> 1449675 T3433 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368713861536/control/data/tlog
[junit4:junit4] 2> 1449676 T3433 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1449677 T3433 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1449680 T3434 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c7b24ac main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1449683 T3433 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1449683 T3433 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1450014 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1450015 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40467_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40467"}
[junit4:junit4] 2> 1450016 T3431 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1450016 T3431 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1450031 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1450687 T3433 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1450687 T3433 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40467 collection:control_collection shard:shard1
[junit4:junit4] 2> 1450688 T3433 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1450764 T3433 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1450792 T3433 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1450792 T3433 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1450792 T3433 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40467/collection1/
[junit4:junit4] 2> 1450793 T3433 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1450793 T3433 oasc.SyncStrategy.syncToMe http://127.0.0.1:40467/collection1/ has no replicas
[junit4:junit4] 2> 1450793 T3433 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40467/collection1/
[junit4:junit4] 2> 1450794 T3433 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1451537 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1451561 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1451609 T3433 oasc.ZkController.register We are http://127.0.0.1:40467/collection1/ and leader is http://127.0.0.1:40467/collection1/
[junit4:junit4] 2> 1451609 T3433 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40467
[junit4:junit4] 2> 1451609 T3433 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1451610 T3433 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1451610 T3433 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1451612 T3433 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1451613 T3408 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1451614 T3408 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1451615 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1451634 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1451636 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1451638 T3437 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@613fa55 name:ZooKeeperConnection Watcher:127.0.0.1:40464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1451638 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1451640 T3408 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1451644 T3408 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1451915 T3408 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1451918 T3408 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40471
[junit4:junit4] 2> 1451919 T3408 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1451920 T3408 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1451920 T3408 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368713865615
[junit4:junit4] 2> 1451921 T3408 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368713865615/solr.xml
[junit4:junit4] 2> 1451921 T3408 oasc.CoreContainer.<init> New CoreContainer 522339624
[junit4:junit4] 2> 1451922 T3408 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368713865615/'
[junit4:junit4] 2> 1451923 T3408 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368713865615/'
[junit4:junit4] 2> 1452081 T3408 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1452081 T3408 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1452082 T3408 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1452082 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1452083 T3408 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1452083 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1452084 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1452085 T3408 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1452085 T3408 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1452086 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1452114 T3408 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1452116 T3408 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40464/solr
[junit4:junit4] 2> 1452117 T3408 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1452118 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1452121 T3448 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67efe650 name:ZooKeeperConnection Watcher:127.0.0.1:40464 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1452122 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1452137 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1452145 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1452147 T3450 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69ec6ece name:ZooKeeperConnection Watcher:127.0.0.1:40464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1452148 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1452158 T3408 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1453068 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1453070 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40467_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40467"}
[junit4:junit4] 2> 1453076 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1453077 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1453077 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1453162 T3408 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40471_
[junit4:junit4] 2> 1453167 T3408 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40471_
[junit4:junit4] 2> 1453171 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1453171 T3437 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1453171 T3430 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1453172 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1453172 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1453174 T3450 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1453179 T3451 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368713865615/collection1
[junit4:junit4] 2> 1453179 T3451 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1453180 T3451 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1453180 T3451 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1453182 T3451 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368713865615/collection1/'
[junit4:junit4] 2> 1453183 T3451 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1368713865615/collection1/lib/README' to classloader
[junit4:junit4] 2> 1453183 T3451 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1368713865615/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1453244 T3451 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1453317 T3451 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1453419 T3451 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1453429 T3451 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1454191 T3451 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1454197 T3451 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1454200 T3451 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1454207 T3451 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1454232 T3451 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1454232 T3451 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368713865615/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty1/
[junit4:junit4] 2> 1454233 T3451 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@524db33c
[junit4:junit4] 2> 1454233 T3451 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1454234 T3451 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty1
[junit4:junit4] 2> 1454235 T3451 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty1/index/
[junit4:junit4] 2> 1454235 T3451 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1454236 T3451 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty1/index
[junit4:junit4] 2> 1454240 T3451 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4930e73c lockFactory=org.apache.lucene.store.NativeFSLockFactory@69020609),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1454240 T3451 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1454243 T3451 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1454244 T3451 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1454244 T3451 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1454245 T3451 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1454246 T3451 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1454246 T3451 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1454246 T3451 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1454247 T3451 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1454248 T3451 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1454281 T3451 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1454288 T3451 oass.SolrIndexSearcher.<init> Opening Searcher@1e286652 main
[junit4:junit4] 2> 1454288 T3451 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty1/tlog
[junit4:junit4] 2> 1454290 T3451 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1454290 T3451 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1454295 T3452 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e286652 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1454297 T3451 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1454297 T3451 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1454591 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1454592 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40471_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40471"}
[junit4:junit4] 2> 1454592 T3431 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1454593 T3431 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1454603 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1454603 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1454603 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1455327 T3451 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1455327 T3451 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40471 collection:collection1 shard:shard1
[junit4:junit4] 2> 1455328 T3451 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1455358 T3451 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1455367 T3451 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1455367 T3451 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1455367 T3451 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40471/collection1/
[junit4:junit4] 2> 1455368 T3451 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1455368 T3451 oasc.SyncStrategy.syncToMe http://127.0.0.1:40471/collection1/ has no replicas
[junit4:junit4] 2> 1455368 T3451 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40471/collection1/
[junit4:junit4] 2> 1455369 T3451 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1456111 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1456145 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1456145 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1456145 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1456157 T3451 oasc.ZkController.register We are http://127.0.0.1:40471/collection1/ and leader is http://127.0.0.1:40471/collection1/
[junit4:junit4] 2> 1456157 T3451 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40471
[junit4:junit4] 2> 1456157 T3451 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1456157 T3451 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1456158 T3451 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1456159 T3451 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1456161 T3408 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1456162 T3408 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1456163 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1456479 T3408 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1456484 T3408 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40474
[junit4:junit4] 2> 1456486 T3408 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1456487 T3408 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1456487 T3408 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368713870153
[junit4:junit4] 2> 1456488 T3408 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368713870153/solr.xml
[junit4:junit4] 2> 1456489 T3408 oasc.CoreContainer.<init> New CoreContainer 198619718
[junit4:junit4] 2> 1456490 T3408 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368713870153/'
[junit4:junit4] 2> 1456491 T3408 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368713870153/'
[junit4:junit4] 2> 1456692 T3408 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1456693 T3408 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1456694 T3408 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1456694 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1456695 T3408 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1456696 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1456697 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1456698 T3408 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1456699 T3408 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1456700 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1456723 T3408 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1456725 T3408 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40464/solr
[junit4:junit4] 2> 1456725 T3408 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1456727 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1456730 T3464 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19915c38 name:ZooKeeperConnection Watcher:127.0.0.1:40464 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1456731 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1456746 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1456756 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1456759 T3466 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bae2a04 name:ZooKeeperConnection Watcher:127.0.0.1:40464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1456759 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1456770 T3408 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1457693 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1457694 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40471_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40471"}
[junit4:junit4] 2> 1457712 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1457712 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1457712 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1457712 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1457773 T3408 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40474_
[junit4:junit4] 2> 1457775 T3408 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40474_
[junit4:junit4] 2> 1457778 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1457778 T3466 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1457778 T3430 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1457778 T3437 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1457779 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1457778 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1457779 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1457787 T3450 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1457792 T3467 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368713870153/collection1
[junit4:junit4] 2> 1457792 T3467 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1457793 T3467 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1457793 T3467 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1457794 T3467 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368713870153/collection1/'
[junit4:junit4] 2> 1457796 T3467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1368713870153/collection1/lib/README' to classloader
[junit4:junit4] 2> 1457797 T3467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1368713870153/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1457884 T3467 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1457956 T3467 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1458059 T3467 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1458065 T3467 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1458830 T3467 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1458838 T3467 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1458843 T3467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1458852 T3467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1458888 T3467 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1458889 T3467 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368713870153/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty2/
[junit4:junit4] 2> 1458890 T3467 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@524db33c
[junit4:junit4] 2> 1458890 T3467 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1458891 T3467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty2
[junit4:junit4] 2> 1458892 T3467 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty2/index/
[junit4:junit4] 2> 1458892 T3467 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1458893 T3467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty2/index
[junit4:junit4] 2> 1458897 T3467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79071bb0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e3b88d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1458897 T3467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1458900 T3467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1458901 T3467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1458902 T3467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1458902 T3467 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1458903 T3467 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1458903 T3467 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1458904 T3467 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1458904 T3467 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1458905 T3467 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1458921 T3467 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1458929 T3467 oass.SolrIndexSearcher.<init> Opening Searcher@20f140b3 main
[junit4:junit4] 2> 1458930 T3467 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty2/tlog
[junit4:junit4] 2> 1458931 T3467 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1458932 T3467 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1458939 T3468 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20f140b3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1458942 T3467 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1458943 T3467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1459216 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1459217 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40474_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40474"}
[junit4:junit4] 2> 1459217 T3431 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1459218 T3431 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1459233 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1459233 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1459233 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1459233 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1459972 T3467 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1459972 T3467 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40474 collection:collection1 shard:shard2
[junit4:junit4] 2> 1459973 T3467 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1460012 T3467 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1460024 T3467 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1460024 T3467 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1460024 T3467 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40474/collection1/
[junit4:junit4] 2> 1460024 T3467 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1460025 T3467 oasc.SyncStrategy.syncToMe http://127.0.0.1:40474/collection1/ has no replicas
[junit4:junit4] 2> 1460025 T3467 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40474/collection1/
[junit4:junit4] 2> 1460025 T3467 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1460739 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1460802 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1460802 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1460802 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1460802 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1460851 T3467 oasc.ZkController.register We are http://127.0.0.1:40474/collection1/ and leader is http://127.0.0.1:40474/collection1/
[junit4:junit4] 2> 1460851 T3467 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40474
[junit4:junit4] 2> 1460851 T3467 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1460851 T3467 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1460851 T3467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1460867 T3467 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1460869 T3408 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1460870 T3408 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1460870 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1461054 T3408 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1461057 T3408 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40481
[junit4:junit4] 2> 1461057 T3408 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1461058 T3408 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1461058 T3408 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368713874856
[junit4:junit4] 2> 1461059 T3408 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368713874856/solr.xml
[junit4:junit4] 2> 1461059 T3408 oasc.CoreContainer.<init> New CoreContainer 145630202
[junit4:junit4] 2> 1461059 T3408 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368713874856/'
[junit4:junit4] 2> 1461060 T3408 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368713874856/'
[junit4:junit4] 2> 1461152 T3408 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1461153 T3408 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1461153 T3408 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1461154 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1461154 T3408 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1461154 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1461155 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1461155 T3408 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1461155 T3408 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1461156 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1461165 T3408 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1461166 T3408 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40464/solr
[junit4:junit4] 2> 1461166 T3408 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1461167 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1461170 T3480 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56730168 name:ZooKeeperConnection Watcher:127.0.0.1:40464 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1461171 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1461197 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1461204 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1461207 T3482 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4535df1d name:ZooKeeperConnection Watcher:127.0.0.1:40464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1461207 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1461216 T3408 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1462219 T3408 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40481_
[junit4:junit4] 2> 1462248 T3408 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40481_
[junit4:junit4] 2> 1462250 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1462251 T3482 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1462251 T3466 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1462251 T3437 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1462251 T3430 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1462252 T3450 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1462252 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1462252 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1462252 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1462265 T3483 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368713874856/collection1
[junit4:junit4] 2> 1462266 T3483 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1462267 T3483 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1462267 T3483 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1462268 T3483 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368713874856/collection1/'
[junit4:junit4] 2> 1462269 T3483 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1368713874856/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1462270 T3483 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1368713874856/collection1/lib/README' to classloader
[junit4:junit4] 2> 1462323 T3483 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1462336 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1462337 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40474_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40474"}
[junit4:junit4] 2> 1462350 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1462351 T3482 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1462350 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1462350 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1462350 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1462388 T3483 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1462492 T3483 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1462498 T3483 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1463108 T3483 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1463112 T3483 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1463115 T3483 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1463120 T3483 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1463139 T3483 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1463140 T3483 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368713874856/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3/
[junit4:junit4] 2> 1463141 T3483 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@524db33c
[junit4:junit4] 2> 1463141 T3483 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1463142 T3483 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3
[junit4:junit4] 2> 1463142 T3483 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3/index/
[junit4:junit4] 2> 1463142 T3483 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1463144 T3483 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3/index
[junit4:junit4] 2> 1463147 T3483 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7bfd7d1c lockFactory=org.apache.lucene.store.NativeFSLockFactory@36a1e669),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1463147 T3483 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1463150 T3483 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1463151 T3483 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1463151 T3483 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1463152 T3483 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1463153 T3483 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1463153 T3483 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1463154 T3483 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1463154 T3483 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1463155 T3483 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1463168 T3483 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1463174 T3483 oass.SolrIndexSearcher.<init> Opening Searcher@45abb540 main
[junit4:junit4] 2> 1463175 T3483 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3/tlog
[junit4:junit4] 2> 1463176 T3483 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1463176 T3483 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1463180 T3484 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@45abb540 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1463183 T3483 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1463183 T3483 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1463855 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1463856 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40481_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40481"}
[junit4:junit4] 2> 1463856 T3431 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1463856 T3431 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1463867 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1463867 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1463867 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1463867 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1463869 T3482 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1464193 T3483 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1464193 T3483 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40481 collection:collection1 shard:shard1
[junit4:junit4] 2> 1464196 T3483 oasc.ZkController.register We are http://127.0.0.1:40481/collection1/ and leader is http://127.0.0.1:40471/collection1/
[junit4:junit4] 2> 1464196 T3483 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40481
[junit4:junit4] 2> 1464196 T3483 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1464196 T3483 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C256 name=collection1 org.apache.solr.core.SolrCore@741e396f url=http://127.0.0.1:40481/collection1 node=127.0.0.1:40481_ C256_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:40481_, base_url=http://127.0.0.1:40481}
[junit4:junit4] 2> 1464197 T3485 C256 P40481 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1464197 T3483 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1464197 T3485 C256 P40481 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1464198 T3485 C256 P40481 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1464198 T3485 C256 P40481 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1464198 T3408 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1464199 T3408 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1464199 T3485 C256 P40481 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1464200 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1464210 T3440 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1464426 T3408 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1464430 T3408 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40488
[junit4:junit4] 2> 1464431 T3408 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1464431 T3408 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1464432 T3408 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368713878181
[junit4:junit4] 2> 1464432 T3408 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368713878181/solr.xml
[junit4:junit4] 2> 1464433 T3408 oasc.CoreContainer.<init> New CoreContainer 538479278
[junit4:junit4] 2> 1464434 T3408 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368713878181/'
[junit4:junit4] 2> 1464434 T3408 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368713878181/'
[junit4:junit4] 2> 1464559 T3408 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1464560 T3408 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1464560 T3408 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1464561 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1464561 T3408 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1464562 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1464562 T3408 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1464563 T3408 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1464563 T3408 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1464564 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1464579 T3408 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1464580 T3408 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40464/solr
[junit4:junit4] 2> 1464581 T3408 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1464582 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1464585 T3497 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73f427c9 name:ZooKeeperConnection Watcher:127.0.0.1:40464 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1464585 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1464599 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1464607 T3408 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1464609 T3499 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6154e6c5 name:ZooKeeperConnection Watcher:127.0.0.1:40464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1464609 T3408 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1464618 T3408 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1465373 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1465374 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40481_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40481"}
[junit4:junit4] 2> 1465412 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1465412 T3482 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1465412 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1465412 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1465412 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1465412 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1465620 T3408 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40488_
[junit4:junit4] 2> 1465622 T3408 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40488_
[junit4:junit4] 2> 1465625 T3482 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1465625 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1465625 T3499 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1465625 T3437 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1465625 T3466 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1465626 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1465626 T3482 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1465625 T3430 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1465625 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1465626 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1465626 T3450 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1465626 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1465635 T3500 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368713878181/collection1
[junit4:junit4] 2> 1465636 T3500 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1465638 T3500 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1465638 T3500 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1465639 T3500 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368713878181/collection1/'
[junit4:junit4] 2> 1465640 T3500 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1368713878181/collection1/lib/README' to classloader
[junit4:junit4] 2> 1465641 T3500 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1368713878181/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1465683 T3500 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1465728 T3500 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1465829 T3500 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1465834 T3500 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1466213 T3440 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1466213 T3440 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:40481_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 1466252 T3500 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1466275 T3500 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1466277 T3500 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1466281 T3500 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1466296 T3500 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1466297 T3500 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368713878181/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/
[junit4:junit4] 2> 1466297 T3500 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@524db33c
[junit4:junit4] 2> 1466297 T3500 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1466298 T3500 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4
[junit4:junit4] 2> 1466298 T3500 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index/
[junit4:junit4] 2> 1466298 T3500 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1466299 T3500 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index
[junit4:junit4] 2> 1466301 T3500 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b70373 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cb55862),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1466302 T3500 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1466304 T3500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1466304 T3500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1466304 T3500 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1466305 T3500 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1466305 T3500 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1466306 T3500 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1466306 T3500 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1466306 T3500 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1466307 T3500 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1466315 T3500 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1466320 T3500 oass.SolrIndexSearcher.<init> Opening Searcher@16016189 main
[junit4:junit4] 2> 1466320 T3500 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/tlog
[junit4:junit4] 2> 1466321 T3500 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1466321 T3500 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1466325 T3501 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16016189 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1466326 T3500 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1466326 T3500 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1466917 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1466918 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40488"}
[junit4:junit4] 2> 1466918 T3431 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1466919 T3431 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1466933 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1466933 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1466933 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1466933 T3482 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1466933 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1466933 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1467355 T3500 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1467355 T3500 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40488 collection:collection1 shard:shard2
[junit4:junit4] 2> 1467358 T3500 oasc.ZkController.register We are http://127.0.0.1:40488/collection1/ and leader is http://127.0.0.1:40474/collection1/
[junit4:junit4] 2> 1467358 T3500 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40488
[junit4:junit4] 2> 1467359 T3500 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1467359 T3500 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C257 name=collection1 org.apache.solr.core.SolrCore@2fdd8d3 url=http://127.0.0.1:40488/collection1 node=127.0.0.1:40488_ C257_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:40488_, base_url=http://127.0.0.1:40488}
[junit4:junit4] 2> 1467359 T3502 C257 P40488 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1467360 T3502 C257 P40488 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1467360 T3502 C257 P40488 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1467360 T3502 C257 P40488 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1467360 T3500 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1467361 T3502 C257 P40488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1467362 T3408 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1467362 T3408 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1467363 T3408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1467375 T3408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1467376 T3456 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1467376 T3408 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1467376 T3408 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1467377 T3408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C256_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:40481_, base_url=http://127.0.0.1:40481}
[junit4:junit4] 2> 1468215 T3485 C256 P40481 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40471/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1468215 T3485 C256 P40481 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40481 START replicas=[http://127.0.0.1:40471/collection1/] nUpdates=100
[junit4:junit4] 2> 1468216 T3485 C256 P40481 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1468217 T3485 C256 P40481 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1468217 T3485 C256 P40481 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1468217 T3485 C256 P40481 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1468217 T3485 C256 P40481 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1468217 T3485 C256 P40481 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40471/collection1/. core=collection1
[junit4:junit4] 2> 1468218 T3485 C256 P40481 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C258 name=collection1 org.apache.solr.core.SolrCore@51b0f368 url=http://127.0.0.1:40471/collection1 node=127.0.0.1:40471_ C258_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:40471_, base_url=http://127.0.0.1:40471, leader=true}
[junit4:junit4] 2> 1468225 T3441 C258 P40471 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1468226 T3442 C258 P40471 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1468228 T3442 C258 P40471 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4930e73c lockFactory=org.apache.lucene.store.NativeFSLockFactory@69020609),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1468229 T3442 C258 P40471 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1468229 T3442 C258 P40471 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4930e73c lockFactory=org.apache.lucene.store.NativeFSLockFactory@69020609),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4930e73c lockFactory=org.apache.lucene.store.NativeFSLockFactory@69020609),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1468230 T3442 C258 P40471 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1468230 T3442 C258 P40471 oass.SolrIndexSearcher.<init> Opening Searcher@7d655a6 realtime
[junit4:junit4] 2> 1468231 T3442 C258 P40471 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1468231 T3442 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 1468232 T3485 C256 P40481 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1468232 T3485 C256 P40481 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1468234 T3443 C258 P40471 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1468235 T3443 C258 P40471 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1468235 T3485 C256 P40481 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1468236 T3485 C256 P40481 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1468236 T3485 C256 P40481 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1468238 T3443 C258 P40471 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1468239 T3485 C256 P40481 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1468239 T3485 C256 P40481 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3/index.20130516101802210
[junit4:junit4] 2> 1468240 T3485 C256 P40481 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@33041115 lockFactory=org.apache.lucene.store.NativeFSLockFactory@367bd851) fullCopy=false
[junit4:junit4] 2> 1468242 T3443 C258 P40471 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1468243 T3485 C256 P40481 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1468244 T3485 C256 P40481 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1468244 T3485 C256 P40481 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1468245 T3485 C256 P40481 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7bfd7d1c lockFactory=org.apache.lucene.store.NativeFSLockFactory@36a1e669),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7bfd7d1c lockFactory=org.apache.lucene.store.NativeFSLockFactory@36a1e669),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1468246 T3485 C256 P40481 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1468246 T3485 C256 P40481 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1468246 T3485 C256 P40481 oass.SolrIndexSearcher.<init> Opening Searcher@4da32b4f main
[junit4:junit4] 2> 1468247 T3484 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4da32b4f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1468248 T3485 C256 P40481 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3/index.20130516101802210 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3/index.20130516101802210;done=true>>]
[junit4:junit4] 2> 1468248 T3485 C256 P40481 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3/index.20130516101802210
[junit4:junit4] 2> 1468248 T3485 C256 P40481 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty3/index.20130516101802210
[junit4:junit4] 2> 1468248 T3485 C256 P40481 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1468248 T3485 C256 P40481 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1468248 T3485 C256 P40481 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1468249 T3485 C256 P40481 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1468278 T3485 C256 P40481 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1468379 T3408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1468437 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1468438 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40488"}
[junit4:junit4] 2> 1468440 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40481_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40481"}
[junit4:junit4] 2> 1468454 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1468454 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1468454 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1468454 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1468454 T3482 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1468454 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1469378 T3456 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1469378 T3456 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:40488_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 1469381 T3408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1470383 T3408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C257_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:40488_, base_url=http://127.0.0.1:40488}
[junit4:junit4] 2> 1471380 T3502 C257 P40488 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:40474/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1471381 T3502 C257 P40488 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40488 START replicas=[http://127.0.0.1:40474/collection1/] nUpdates=100
[junit4:junit4] 2> 1471391 T3408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1471396 T3502 C257 P40488 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1471396 T3502 C257 P40488 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1471396 T3502 C257 P40488 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1471397 T3502 C257 P40488 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1471397 T3502 C257 P40488 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1471397 T3502 C257 P40488 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:40474/collection1/. core=collection1
[junit4:junit4] 2> 1471398 T3502 C257 P40488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C259 name=collection1 org.apache.solr.core.SolrCore@19d59e59 url=http://127.0.0.1:40474/collection1 node=127.0.0.1:40474_ C259_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:40474_, base_url=http://127.0.0.1:40474, leader=true}
[junit4:junit4] 2> 1471413 T3457 C259 P40474 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1471415 T3458 C259 P40474 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1471417 T3458 C259 P40474 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79071bb0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e3b88d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1471417 T3458 C259 P40474 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1471418 T3458 C259 P40474 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79071bb0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e3b88d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79071bb0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e3b88d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1471418 T3458 C259 P40474 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1471419 T3458 C259 P40474 oass.SolrIndexSearcher.<init> Opening Searcher@7d00b03a realtime
[junit4:junit4] 2> 1471419 T3458 C259 P40474 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1471419 T3458 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 1471420 T3502 C257 P40488 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1471421 T3502 C257 P40488 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1471511 T3459 C259 P40474 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1471512 T3459 C259 P40474 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=90
[junit4:junit4] 2> 1471512 T3502 C257 P40488 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1471512 T3502 C257 P40488 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1471513 T3502 C257 P40488 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1471515 T3459 C259 P40474 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1471516 T3502 C257 P40488 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1471516 T3502 C257 P40488 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index.20130516101805487
[junit4:junit4] 2> 1471517 T3502 C257 P40488 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@5355e98d lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f80b90b) fullCopy=false
[junit4:junit4] 2> 1471519 T3459 C259 P40474 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1471520 T3502 C257 P40488 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1471521 T3502 C257 P40488 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1471521 T3502 C257 P40488 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1471522 T3502 C257 P40488 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b70373 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cb55862),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b70373 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cb55862),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1471522 T3502 C257 P40488 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1471522 T3502 C257 P40488 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1471523 T3502 C257 P40488 oass.SolrIndexSearcher.<init> Opening Searcher@2b0ea4f0 main
[junit4:junit4] 2> 1471524 T3501 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b0ea4f0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1471524 T3502 C257 P40488 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index.20130516101805487 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index.20130516101805487;done=true>>]
[junit4:junit4] 2> 1471524 T3502 C257 P40488 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index.20130516101805487
[junit4:junit4] 2> 1471524 T3502 C257 P40488 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index.20130516101805487
[junit4:junit4] 2> 1471524 T3502 C257 P40488 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1471525 T3502 C257 P40488 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1471525 T3502 C257 P40488 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1471525 T3502 C257 P40488 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1471529 T3502 C257 P40488 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1472393 T3408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1473014 T3431 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1473015 T3431 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:40488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40488"}
[junit4:junit4] 2> 1473031 T3437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1473031 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1473031 T3482 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1473031 T3430 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1473031 T3466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1473031 T3450 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1473395 T3408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1473396 T3408 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C260 name=collection1 org.apache.solr.core.SolrCore@1cfa5f21 url=http://127.0.0.1:40467/collection1 node=127.0.0.1:40467_ C260_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:40467_, base_url=http://127.0.0.1:40467, leader=true}
[junit4:junit4] 2> 1473405 T3420 C260 P40467 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1473408 T3420 C260 P40467 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@35babddb lockFactory=org.apache.lucene.store.NativeFSLockFactory@3003a91),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1473409 T3420 C260 P40467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1473409 T3420 C260 P40467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@35babddb lockFactory=org.apache.lucene.store.NativeFSLockFactory@3003a91),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@35babddb lockFactory=org.apache.lucene.store.NativeFSLockFactory@3003a91),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1473410 T3420 C260 P40467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1473410 T3420 C260 P40467 oass.SolrIndexSearcher.<init> Opening Searcher@ffa25bd main
[junit4:junit4] 2> 1473411 T3420 C260 P40467 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1473412 T3434 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ffa25bd main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1473412 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1473423 T3444 C258 P40471 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1473425 T3444 C258 P40471 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4930e73c lockFactory=org.apache.lucene.store.NativeFSLockFactory@69020609),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4930e73c lockFactory=org.apache.lucene.store.NativeFSLockFactory@69020609),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1473426 T3444 C258 P40471 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1473426 T3444 C258 P40471 oass.SolrIndexSearcher.<init> Opening Searcher@706ebea7 main
[junit4:junit4] 2> 1473427 T3444 C258 P40471 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1473428 T3452 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@706ebea7 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1473428 T3444 C258 P40471 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:40481/collection1/, StdNode: http://127.0.0.1:40474/collection1/, StdNode: http://127.0.0.1:40488/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1473432 T3460 C259 P40474 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1473433 T3460 C259 P40474 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79071bb0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e3b88d),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79071bb0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e3b88d),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1473434 T3460 C259 P40474 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1473435 T3460 C259 P40474 oass.SolrIndexSearcher.<init> Opening Searcher@62538429 main
[junit4:junit4] 2> 1473436 T3460 C259 P40474 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1473436 T3468 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@62538429 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1473437 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> C257_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:40488_, base_url=http://127.0.0.1:40488}
[junit4:junit4] 2> 1473439 T3489 C257 P40488 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1473441 T3489 C257 P40488 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b70373 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cb55862),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b70373 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cb55862),segFN=segments_3,generation=3}
[junit4:junit4] 2> C256_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:40481_, base_url=http://127.0.0.1:40481}
[junit4:junit4] 2> 1473441 T3472 C256 P40481 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1473441 T3489 C257 P40488 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1473442 T3472 C256 P40481 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7bfd7d1c lockFactory=org.apache.lucene.store.NativeFSLockFactory@36a1e669),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7bfd7d1c lockFactory=org.apache.lucene.store.NativeFSLockFactory@36a1e669),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1473443 T3489 C257 P40488 oass.SolrIndexSearcher.<init> Opening Searcher@524a2482 main
[junit4:junit4] 2> 1473443 T3472 C256 P40481 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1473444 T3489 C257 P40488 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1473444 T3472 C256 P40481 oass.SolrIndexSearcher.<init> Opening Searcher@7a78d1c4 main
[junit4:junit4] 2> 1473445 T3501 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@524a2482 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1473445 T3472 C256 P40481 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1473446 T3489 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1473446 T3484 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7a78d1c4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1473447 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1473447 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 24
[junit4:junit4] 2> 1473449 T3408 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1473451 T3445 C258 P40471 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1473453 T3473 C256 P40481 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1473455 T3461 C259 P40474 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1473457 T3490 C257 P40488 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1475462 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435200535324000256)} 0 2
[junit4:junit4] 2> 1475468 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435200535328194560&update.from=http://127.0.0.1:40471/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435200535328194560)} 0 1
[junit4:junit4] 2> 1475471 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435200535331340288&update.from=http://127.0.0.1:40474/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435200535331340288)} 0 1
[junit4:junit4] 2> 1475472 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435200535331340288)} 0 5
[junit4:junit4] 2> 1475473 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435200535328194560)} 0 9
[junit4:junit4] 2> 1475475 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1435200535339728896)]} 0 0
[junit4:junit4] 2> 1475482 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435200535344971776)]} 0 0
[junit4:junit4] 2> 1475483 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1435200535344971776)]} 0 3
[junit4:junit4] 2> 1475483 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0]} 0 5
[junit4:junit4] 2> 1475486 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435200535351263232)]} 0 0
[junit4:junit4] 2> 1475491 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435200535354408960)]} 0 0
[junit4:junit4] 2> 1475492 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435200535354408960)]} 0 3
[junit4:junit4] 2> 1475495 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435200535360700416)]} 0 0
[junit4:junit4] 2> 1475500 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435200535363846144)]} 0 0
[junit4:junit4] 2> 1475501 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1435200535363846144)]} 0 3
[junit4:junit4] 2> 1475502 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2]} 0 5
[junit4:junit4] 2> 1475504 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435200535370137600)]} 0 0
[junit4:junit4] 2> 1475509 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435200535373283328)]} 0 0
[junit4:junit4] 2> 1475510 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435200535373283328)]} 0 3
[junit4:junit4] 2> 1475512 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435200535378526208)]} 0 0
[junit4:junit4] 2> 1475517 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435200535381671936)]} 0 0
[junit4:junit4] 2> 1475518 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435200535381671936)]} 0 3
[junit4:junit4] 2> 1475521 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435200535387963392)]} 0 0
[junit4:junit4] 2> 1475528 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435200535393206272)]} 0 0
[junit4:junit4] 2> 1475529 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1435200535393206272)]} 0 3
[junit4:junit4] 2> 1475530 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5]} 0 6
[junit4:junit4] 2> 1475532 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1435200535399497728)]} 0 0
[junit4:junit4] 2> 1475539 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435200535404740608)]} 0 0
[junit4:junit4] 2> 1475540 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1435200535404740608)]} 0 3
[junit4:junit4] 2> 1475541 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6]} 0 6
[junit4:junit4] 2> 1475543 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435200535411032064)]} 0 0
[junit4:junit4] 2> 1475550 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435200535416274944)]} 0 0
[junit4:junit4] 2> 1475551 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1435200535416274944)]} 0 3
[junit4:junit4] 2> 1475552 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7]} 0 6
[junit4:junit4] 2> 1475554 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435200535422566400)]} 0 0
[junit4:junit4] 2> 1475559 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435200535425712128)]} 0 0
[junit4:junit4] 2> 1475560 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435200535425712128)]} 0 3
[junit4:junit4] 2> 1475562 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435200535430955008)]} 0 0
[junit4:junit4] 2> 1475569 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435200535436197888)]} 0 0
[junit4:junit4] 2> 1475570 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!9 (1435200535436197888)]} 0 3
[junit4:junit4] 2> 1475571 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9]} 0 6
[junit4:junit4] 2> 1475573 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1435200535442489344)]} 0 0
[junit4:junit4] 2> 1475580 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435200535447732224)]} 0 0
[junit4:junit4] 2> 1475581 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1435200535447732224)]} 0 3
[junit4:junit4] 2> 1475582 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10]} 0 6
[junit4:junit4] 2> 1475584 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435200535454023680)]} 0 0
[junit4:junit4] 2> 1475589 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435200535457169408)]} 0 0
[junit4:junit4] 2> 1475589 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435200535457169408)]} 0 2
[junit4:junit4] 2> 1475592 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435200535462412288)]} 0 0
[junit4:junit4] 2> 1475600 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435200535467655168)]} 0 1
[junit4:junit4] 2> 1475603 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1435200535467655168)]} 0 6
[junit4:junit4] 2> 1475604 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12]} 0 9
[junit4:junit4] 2> 1475606 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435200535477092352)]} 0 0
[junit4:junit4] 2> 1475611 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435200535480238080)]} 0 0
[junit4:junit4] 2> 1475612 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435200535480238080)]} 0 3
[junit4:junit4] 2> 1475615 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435200535486529536)]} 0 0
[junit4:junit4] 2> 1475620 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435200535489675264)]} 0 0
[junit4:junit4] 2> 1475621 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435200535489675264)]} 0 3
[junit4:junit4] 2> 1475623 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435200535494918144)]} 0 0
[junit4:junit4] 2> 1475629 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435200535498063872)]} 0 0
[junit4:junit4] 2> 1475630 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435200535498063872)]} 0 4
[junit4:junit4] 2> 1475633 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435200535505403904)]} 0 0
[junit4:junit4] 2> 1475640 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435200535510646784)]} 0 0
[junit4:junit4] 2> 1475640 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1435200535510646784)]} 0 2
[junit4:junit4] 2> 1475641 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16]} 0 5
[junit4:junit4] 2> 1475643 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435200535515889664)]} 0 0
[junit4:junit4] 2> 1475649 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435200535520083968)]} 0 0
[junit4:junit4] 2> 1475649 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!17 (1435200535520083968)]} 0 2
[junit4:junit4] 2> 1475650 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17]} 0 5
[junit4:junit4] 2> 1475652 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1435200535525326848)]} 0 0
[junit4:junit4] 2> 1475658 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435200535529521152)]} 0 0
[junit4:junit4] 2> 1475658 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1435200535529521152)]} 0 2
[junit4:junit4] 2> 1475659 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18]} 0 5
[junit4:junit4] 2> 1475661 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435200535534764032)]} 0 0
[junit4:junit4] 2> 1475665 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435200535536861184)]} 0 0
[junit4:junit4] 2> 1475665 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435200535536861184)]} 0 2
[junit4:junit4] 2> 1475668 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1435200535542104064)]} 0 0
[junit4:junit4] 2> 1475674 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435200535546298368)]} 0 0
[junit4:junit4] 2> 1475674 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1435200535546298368)]} 0 2
[junit4:junit4] 2> 1475675 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 5
[junit4:junit4] 2> 1475677 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435200535551541248)]} 0 0
[junit4:junit4] 2> 1475681 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435200535553638400)]} 0 0
[junit4:junit4] 2> 1475681 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435200535553638400)]} 0 2
[junit4:junit4] 2> 1475684 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435200535558881280)]} 0 0
[junit4:junit4] 2> 1475688 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435200535560978432)]} 0 0
[junit4:junit4] 2> 1475688 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435200535560978432)]} 0 2
[junit4:junit4] 2> 1475691 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435200535566221312)]} 0 0
[junit4:junit4] 2> 1475697 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435200535570415616)]} 0 0
[junit4:junit4] 2> 1475697 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1435200535570415616)]} 0 2
[junit4:junit4] 2> 1475698 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23]} 0 5
[junit4:junit4] 2> 1475700 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1435200535575658496)]} 0 0
[junit4:junit4] 2> 1475706 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435200535579852800)]} 0 0
[junit4:junit4] 2> 1475706 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1435200535579852800)]} 0 2
[junit4:junit4] 2> 1475707 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24]} 0 5
[junit4:junit4] 2> 1475709 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435200535585095680)]} 0 0
[junit4:junit4] 2> 1475713 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435200535587192832)]} 0 0
[junit4:junit4] 2> 1475713 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435200535587192832)]} 0 2
[junit4:junit4] 2> 1475716 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435200535592435712)]} 0 0
[junit4:junit4] 2> 1475720 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435200535594532864)]} 0 0
[junit4:junit4] 2> 1475720 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435200535594532864)]} 0 2
[junit4:junit4] 2> 1475723 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1435200535599775744)]} 0 0
[junit4:junit4] 2> 1475730 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435200535605018624)]} 0 0
[junit4:junit4] 2> 1475731 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1435200535605018624)]} 0 3
[junit4:junit4] 2> 1475731 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 5
[junit4:junit4] 2> 1475733 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435200535610261504)]} 0 0
[junit4:junit4] 2> 1475737 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435200535612358656)]} 0 0
[junit4:junit4] 2> 1475738 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435200535612358656)]} 0 3
[junit4:junit4] 2> 1475740 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1435200535617601536)]} 0 0
[junit4:junit4] 2> 1475747 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435200535622844416)]} 0 0
[junit4:junit4] 2> 1475748 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1435200535622844416)]} 0 3
[junit4:junit4] 2> 1475748 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29]} 0 5
[junit4:junit4] 2> 1475751 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435200535629135872)]} 0 0
[junit4:junit4] 2> 1475757 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435200535633330176)]} 0 0
[junit4:junit4] 2> 1475757 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!30 (1435200535633330176)]} 0 2
[junit4:junit4] 2> 1475758 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30]} 0 5
[junit4:junit4] 2> 1475760 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435200535638573056)]} 0 0
[junit4:junit4] 2> 1475764 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435200535640670208)]} 0 0
[junit4:junit4] 2> 1475764 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435200535640670208)]} 0 2
[junit4:junit4] 2> 1475767 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435200535645913088)]} 0 0
[junit4:junit4] 2> 1475772 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435200535649058816)]} 0 0
[junit4:junit4] 2> 1475772 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435200535649058816)]} 0 2
[junit4:junit4] 2> 1475775 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1435200535654301696)]} 0 0
[junit4:junit4] 2> 1475781 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435200535658496000)]} 0 0
[junit4:junit4] 2> 1475781 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1435200535658496000)]} 0 2
[junit4:junit4] 2> 1475782 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33]} 0 5
[junit4:junit4] 2> 1475784 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435200535663738880)]} 0 0
[junit4:junit4] 2> 1475788 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435200535665836032)]} 0 0
[junit4:junit4] 2> 1475788 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435200535665836032)]} 0 2
[junit4:junit4] 2> 1475791 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435200535671078912)]} 0 0
[junit4:junit4] 2> 1475796 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435200535674224640)]} 0 0
[junit4:junit4] 2> 1475796 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435200535674224640)]} 0 2
[junit4:junit4] 2> 1475799 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435200535679467520)]} 0 0
[junit4:junit4] 2> 1475804 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1435200535682613248)]} 0 0
[junit4:junit4] 2> 1475804 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435200535682613248)]} 0 2
[junit4:junit4] 2> 1475807 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1435200535687856128)]} 0 0
[junit4:junit4] 2> 1475818 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1435200535693099008)]} 0 1
[junit4:junit4] 2> 1475819 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1435200535693099008)]} 0 7
[junit4:junit4] 2> 1475819 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37]} 0 9
[junit4:junit4] 2> 1475822 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435200535703584768)]} 0 0
[junit4:junit4] 2> 1475827 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1435200535706730496)]} 0 0
[junit4:junit4] 2> 1475827 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435200535706730496)]} 0 2
[junit4:junit4] 2> 1475830 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1435200535711973376)]} 0 0
[junit4:junit4] 2> 1475837 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1435200535717216256)]} 0 0
[junit4:junit4] 2> 1475837 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1435200535717216256)]} 0 2
[junit4:junit4] 2> 1475838 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39]} 0 5
[junit4:junit4] 2> 1475840 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435200535722459136)]} 0 0
[junit4:junit4] 2> 1475845 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1435200535725604864)]} 0 0
[junit4:junit4] 2> 1475846 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435200535725604864)]} 0 3
[junit4:junit4] 2> 1475848 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1435200535730847744)]} 0 0
[junit4:junit4] 2> 1475855 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1435200535736090624)]} 0 0
[junit4:junit4] 2> 1475856 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!41 (1435200535736090624)]} 0 3
[junit4:junit4] 2> 1475856 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41]} 0 5
[junit4:junit4] 2> 1475859 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435200535742382080)]} 0 0
[junit4:junit4] 2> 1475864 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1435200535745527808)]} 0 0
[junit4:junit4] 2> 1475865 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435200535745527808)]} 0 3
[junit4:junit4] 2> 1475867 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435200535750770688)]} 0 0
[junit4:junit4] 2> 1475872 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1435200535753916416)]} 0 0
[junit4:junit4] 2> 1475873 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435200535753916416)]} 0 3
[junit4:junit4] 2> 1475875 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435200535759159296)]} 0 0
[junit4:junit4] 2> 1475882 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1435200535764402176)]} 0 0
[junit4:junit4] 2> 1475883 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!44 (1435200535764402176)]} 0 3
[junit4:junit4] 2> 1475883 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44]} 0 5
[junit4:junit4] 2> 1475886 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435200535770693632)]} 0 0
[junit4:junit4] 2> 1475890 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1435200535772790784)]} 0 0
[junit4:junit4] 2> 1475890 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435200535772790784)]} 0 2
[junit4:junit4] 2> 1475893 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435200535778033664)]} 0 0
[junit4:junit4] 2> 1475897 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1435200535780130816)]} 0 0
[junit4:junit4] 2> 1475897 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435200535780130816)]} 0 2
[junit4:junit4] 2> 1475900 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1435200535785373696)]} 0 0
[junit4:junit4] 2> 1475906 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1435200535789568000)]} 0 0
[junit4:junit4] 2> 1475907 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1435200535789568000)]} 0 3
[junit4:junit4] 2> 1475907 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 5
[junit4:junit4] 2> 1475910 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435200535795859456)]} 0 0
[junit4:junit4] 2> 1475917 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1435200535801102336)]} 0 0
[junit4:junit4] 2> 1475918 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!48 (1435200535801102336)]} 0 3
[junit4:junit4] 2> 1475918 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48]} 0 5
[junit4:junit4] 2> 1475921 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1435200535807393792)]} 0 0
[junit4:junit4] 2> 1475926 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1435200535810539520)]} 0 0
[junit4:junit4] 2> 1475927 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1435200535810539520)]} 0 3
[junit4:junit4] 2> 1475929 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435200535815782400)]} 0 0
[junit4:junit4] 2> 1475934 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1435200535818928128)]} 0 0
[junit4:junit4] 2> 1475935 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435200535818928128)]} 0 3
[junit4:junit4] 2> 1475937 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435200535824171008)]} 0 0
[junit4:junit4] 2> 1475944 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1435200535829413888)]} 0 0
[junit4:junit4] 2> 1475945 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!51 (1435200535829413888)]} 0 3
[junit4:junit4] 2> 1475946 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51]} 0 6
[junit4:junit4] 2> 1475948 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435200535835705344)]} 0 0
[junit4:junit4] 2> 1475953 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1435200535838851072)]} 0 0
[junit4:junit4] 2> 1475954 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435200535838851072)]} 0 3
[junit4:junit4] 2> 1475956 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435200535844093952)]} 0 0
[junit4:junit4] 2> 1475963 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1435200535849336832)]} 0 0
[junit4:junit4] 2> 1475964 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1435200535849336832)]} 0 3
[junit4:junit4] 2> 1475964 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53]} 0 5
[junit4:junit4] 2> 1475967 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435200535855628288)]} 0 0
[junit4:junit4] 2> 1475972 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1435200535858774016)]} 0 0
[junit4:junit4] 2> 1475973 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435200535858774016)]} 0 3
[junit4:junit4] 2> 1475976 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435200535865065472)]} 0 0
[junit4:junit4] 2> 1475981 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1435200535868211200)]} 0 0
[junit4:junit4] 2> 1475982 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435200535868211200)]} 0 3
[junit4:junit4] 2> 1475984 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1435200535873454080)]} 0 0
[junit4:junit4] 2> 1475991 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1435200535878696960)]} 0 0
[junit4:junit4] 2> 1475992 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1435200535878696960)]} 0 3
[junit4:junit4] 2> 1475992 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 5
[junit4:junit4] 2> 1475995 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435200535884988416)]} 0 0
[junit4:junit4] 2> 1476002 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1435200535890231296)]} 0 0
[junit4:junit4] 2> 1476003 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1435200535890231296)]} 0 3
[junit4:junit4] 2> 1476004 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57]} 0 6
[junit4:junit4] 2> 1476006 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435200535896522752)]} 0 0
[junit4:junit4] 2> 1476013 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1435200535901765632)]} 0 0
[junit4:junit4] 2> 1476014 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1435200535901765632)]} 0 3
[junit4:junit4] 2> 1476015 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58]} 0 6
[junit4:junit4] 2> 1476017 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435200535908057088)]} 0 0
[junit4:junit4] 2> 1476028 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1435200535917494272)]} 0 0
[junit4:junit4] 2> 1476029 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435200535917494272)]} 0 3
[junit4:junit4] 2> 1476032 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1435200535923785728)]} 0 0
[junit4:junit4] 2> 1476039 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1435200535929028608)]} 0 0
[junit4:junit4] 2> 1476040 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1435200535929028608)]} 0 3
[junit4:junit4] 2> 1476040 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60]} 0 5
[junit4:junit4] 2> 1476043 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435200535935320064)]} 0 0
[junit4:junit4] 2> 1476048 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1435200535938465792)]} 0 0
[junit4:junit4] 2> 1476049 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435200535938465792)]} 0 3
[junit4:junit4] 2> 1476051 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435200535943708672)]} 0 0
[junit4:junit4] 2> 1476058 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1435200535948951552)]} 0 0
[junit4:junit4] 2> 1476059 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!62 (1435200535948951552)]} 0 3
[junit4:junit4] 2> 1476060 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62]} 0 6
[junit4:junit4] 2> 1476062 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1435200535955243008)]} 0 0
[junit4:junit4] 2> 1476069 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1435200535960485888)]} 0 0
[junit4:junit4] 2> 1476070 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!63 (1435200535960485888)]} 0 3
[junit4:junit4] 2> 1476071 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63]} 0 6
[junit4:junit4] 2> 1476074 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1435200535967825920)]} 0 0
[junit4:junit4] 2> 1476081 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1435200535973068800)]} 0 0
[junit4:junit4] 2> 1476082 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!64 (1435200535973068800)]} 0 3
[junit4:junit4] 2> 1476083 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64]} 0 6
[junit4:junit4] 2> 1476085 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435200535979360256)]} 0 0
[junit4:junit4] 2> 1476092 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1435200535984603136)]} 0 0
[junit4:junit4] 2> 1476093 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!65 (1435200535984603136)]} 0 3
[junit4:junit4] 2> 1476094 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65]} 0 6
[junit4:junit4] 2> 1476096 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1435200535990894592)]} 0 0
[junit4:junit4] 2> 1476103 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1435200535996137472)]} 0 0
[junit4:junit4] 2> 1476104 T3460 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1435200535996137472)]} 0 3
[junit4:junit4] 2> 1476105 T3444 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66]} 0 6
[junit4:junit4] 2> 1476108 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1435200536003477504)]} 0 0
[junit4:junit4] 2> 1476115 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1435200536008720384)]} 0 0
[junit4:junit4] 2> 1476116 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!67 (1435200536008720384)]} 0 3
[junit4:junit4] 2> 1476117 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67]} 0 6
[junit4:junit4] 2> 1476119 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1435200536015011840)]} 0 0
[junit4:junit4] 2> 1476126 T3472 C256 P40481 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40471/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1435200536020254720)]} 0 0
[junit4:junit4] 2> 1476127 T3446 C258 P40471 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!68 (1435200536020254720)]} 0 3
[junit4:junit4] 2> 1476127 T3462 C259 P40474 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68]} 0 5
[junit4:junit4] 2> 1476130 T3420 C260 P40467 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69 (1435200536026546176)]} 0 0
[junit4:junit4] 2> 1476137 T3491 C257 P40488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:40474/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!69 (1435200536031789056)]} 0 0
[junit4:junit4] 2> 1476138 T3460 C259 P40474 oas
[...truncated too long message...]
ors=0}
[junit4:junit4] 2> 1515783 T3499 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1515783 T3499 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1515783 T3499 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1515785 T3499 C257 P40488 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b70373 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cb55862),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b70373 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cb55862),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1515785 T3499 C257 P40488 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1515785 T3499 C257 P40488 oasu.TransactionLog.forceClose ERROR Error: Forcing close of tlog{file=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/tlog/tlog.0000000000000000002 refcount=1}
[junit4:junit4] 2> 1515786 T3499 C257 P40488 oasu.TransactionLog.forceClose ERROR Error: Forcing close of tlog{file=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/tlog/tlog.0000000000000000001 refcount=1}
[junit4:junit4] 2> 1515788 T3499 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1515788 T3499 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1515788 T3499 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4;done=false>>]
[junit4:junit4] 2> 1515789 T3499 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4
[junit4:junit4] 2> 1515789 T3499 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index;done=false>>]
[junit4:junit4] 2> 1515789 T3499 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368713861536/jetty4/index
[junit4:junit4] 2> 1515789 T3499 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1515789 T3499 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89700031630147596-5-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:246)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1515790 T3499 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1515790 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1515790 T3499 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1515791 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1515791 T3499 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1515791 T3499 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ms, timezone=America/Blanc-Sablon
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=2,free=109292808,total=395313152
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestSchemaVersionResource, JsonLoaderTest, ClusterStateTest, TestRangeQuery, ClusterStateUpdateTest, SOLR749Test, TestUtils, OverseerCollectionProcessorTest, IndexSchemaRuntimeFieldTest, TestCodecSupport, BadComponentTest, TestAddFieldRealTimeGet, FieldMutatingUpdateProcessorTest, TestSolr4Spatial, TestTrie, CoreAdminHandlerTest, DirectUpdateHandlerTest, TestFastLRUCache, TestJmxMonitoredMap, BasicDistributedZkTest, TestCollationKeyRangeQueries, TestIBSimilarityFactory, TestBinaryField, TestSweetSpotSimilarityFactory, PreAnalyzedUpdateProcessorTest, TestSystemIdResolver, TermsComponentTest, HighlighterConfigTest, AnalysisAfterCoreReloadTest, TestPluginEnable, TestLRUCache, NumericFieldsTest, UUIDFieldTest, TestPropInject, TestLuceneMatchVersion, PingRequestHandlerTest, TestSolrCoreProperties, SimplePostToolTest, TestCoreContainer, ZkControllerTest, TestFieldTypeCollectionResource, SolrCoreTest, SolrCmdDistributorTest, TestDistributedGrouping, TestMergePolicyConfig, OverseerTest, SolrInfoMBeanTest, AutoCommitTest, QueryResultKeyTest, ZkSolrClientTest, SolrRequestParserTest, TestOmitPositions, DocValuesMultiTest, TestRecovery, CurrencyFieldXmlFileTest, BasicDistributedZk2Test, PrimUtilsTest, TestSolrQueryParser, TestShardHandlerFactory, CollectionsAPIDistributedZkTest, TestGroupingSearch, TestRemoteStreaming, TestBM25SimilarityFactory, DistributedSpellCheckComponentTest, ReturnFieldsTest, IndexReaderFactoryTest, OpenCloseCoreStressTest, SolrIndexSplitterTest, FieldAnalysisRequestHandlerTest, TestDefaultSearchFieldResource, ChaosMonkeyNothingIsSafeTest, TestSchemaSimilarityResource, TestPostingsSolrHighlighter, ChaosMonkeyShardSplitTest, ChaosMonkeySafeLeaderTest, ShardSplitTest]
[junit4:junit4] Completed on J1 in 68.38s, 1 test, 1 error <<< FAILURES!
[...truncated 492 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 27 ignored (8 assumptions)
Total time: 55 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1252 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1252/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:53714/tg_hv/k returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:53714/tg_hv/k returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([AAFC73EE92C555A7:2B1AFDF6E59A359B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9584 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 741323 T2087 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /tg_hv/k
[junit4:junit4] 2> 741330 T2087 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1368688089274
[junit4:junit4] 2> 741331 T2087 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 741332 T2088 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 741433 T2087 oasc.ZkTestServer.run start zk server on port:53707
[junit4:junit4] 2> 741434 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 741449 T2094 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6fa00653 name:ZooKeeperConnection Watcher:127.0.0.1:53707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 741450 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 741450 T2087 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 741468 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 741470 T2096 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41cc6875 name:ZooKeeperConnection Watcher:127.0.0.1:53707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 741470 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 741470 T2087 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 741505 T2087 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 741508 T2087 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 741545 T2087 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 741549 T2087 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 741549 T2087 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 741562 T2087 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 741563 T2087 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 741673 T2087 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 741674 T2087 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 741677 T2087 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 741678 T2087 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 741682 T2087 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 741683 T2087 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 741688 T2087 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 741689 T2087 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 741692 T2087 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 741693 T2087 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 741697 T2087 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 741697 T2087 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 741701 T2087 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 741701 T2087 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 741915 T2087 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 741920 T2087 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:53710
[junit4:junit4] 2> 741920 T2087 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 741921 T2087 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 741922 T2087 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368688089649
[junit4:junit4] 2> 741922 T2087 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368688089649/solr.xml
[junit4:junit4] 2> 741923 T2087 oasc.CoreContainer.<init> New CoreContainer 894997512
[junit4:junit4] 2> 741923 T2087 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368688089649/'
[junit4:junit4] 2> 741924 T2087 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368688089649/'
[junit4:junit4] 2> 742039 T2087 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 742040 T2087 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 742041 T2087 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 742041 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 742042 T2087 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 742042 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 742043 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 742043 T2087 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 742044 T2087 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 742044 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 742061 T2087 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 742061 T2087 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53707/solr
[junit4:junit4] 2> 742062 T2087 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 742063 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 742091 T2107 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d7dd053 name:ZooKeeperConnection Watcher:127.0.0.1:53707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 742092 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 742095 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 742107 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 742109 T2109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a84772f name:ZooKeeperConnection Watcher:127.0.0.1:53707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 742109 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 742112 T2087 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 742122 T2087 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 742126 T2087 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 742128 T2087 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53710_tg_hv%2Fk
[junit4:junit4] 2> 742136 T2087 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53710_tg_hv%2Fk
[junit4:junit4] 2> 742140 T2087 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 742152 T2087 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 742160 T2087 oasc.Overseer.start Overseer (id=89698342619054083-127.0.0.1:53710_tg_hv%2Fk-n_0000000000) starting
[junit4:junit4] 2> 742170 T2087 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 742182 T2111 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 742183 T2087 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 742186 T2087 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 742188 T2087 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 742191 T2110 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 742195 T2112 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368688089649/collection1
[junit4:junit4] 2> 742195 T2112 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 742196 T2112 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 742196 T2112 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 742198 T2112 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368688089649/collection1/'
[junit4:junit4] 2> 742199 T2112 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368688089649/collection1/lib/README' to classloader
[junit4:junit4] 2> 742200 T2112 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368688089649/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 742251 T2112 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 742311 T2112 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 742412 T2112 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 742417 T2112 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 742995 T2112 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 742999 T2112 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 743002 T2112 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 743007 T2112 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 743033 T2112 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 743033 T2112 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368688089649/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/control/data/
[junit4:junit4] 2> 743034 T2112 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6efc82
[junit4:junit4] 2> 743034 T2112 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 743035 T2112 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/control/data
[junit4:junit4] 2> 743035 T2112 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/control/data/index/
[junit4:junit4] 2> 743036 T2112 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 743036 T2112 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/control/data/index
[junit4:junit4] 2> 743040 T2112 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@70095a0a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3239d2ab),segFN=segments_1,generation=1}
[junit4:junit4] 2> 743040 T2112 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 743043 T2112 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 743043 T2112 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 743044 T2112 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 743045 T2112 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 743045 T2112 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 743046 T2112 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 743046 T2112 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 743046 T2112 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 743047 T2112 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 743060 T2112 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 743066 T2112 oass.SolrIndexSearcher.<init> Opening Searcher@36c78577 main
[junit4:junit4] 2> 743066 T2112 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/control/data/tlog
[junit4:junit4] 2> 743067 T2112 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 743067 T2112 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 743071 T2113 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@36c78577 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 743073 T2112 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 743073 T2112 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 743695 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 743696 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53710_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53710/tg_hv/k"}
[junit4:junit4] 2> 743696 T2110 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 743696 T2110 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 743735 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 744076 T2112 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 744076 T2112 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53710/tg_hv/k collection:control_collection shard:shard1
[junit4:junit4] 2> 744077 T2112 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 744094 T2112 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 744105 T2112 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 744105 T2112 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 744106 T2112 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53710/tg_hv/k/collection1/
[junit4:junit4] 2> 744106 T2112 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 744106 T2112 oasc.SyncStrategy.syncToMe http://127.0.0.1:53710/tg_hv/k/collection1/ has no replicas
[junit4:junit4] 2> 744106 T2112 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53710/tg_hv/k/collection1/
[junit4:junit4] 2> 744107 T2112 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 745240 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 745258 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 745286 T2112 oasc.ZkController.register We are http://127.0.0.1:53710/tg_hv/k/collection1/ and leader is http://127.0.0.1:53710/tg_hv/k/collection1/
[junit4:junit4] 2> 745286 T2112 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53710/tg_hv/k
[junit4:junit4] 2> 745286 T2112 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 745286 T2112 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 745287 T2112 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 745289 T2112 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 745290 T2087 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 745290 T2087 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 745291 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 745305 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 745307 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 745309 T2116 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c3f6a81 name:ZooKeeperConnection Watcher:127.0.0.1:53707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 745309 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 745311 T2087 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 745314 T2087 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 745527 T2087 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 745530 T2087 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:53714
[junit4:junit4] 2> 745531 T2087 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 745532 T2087 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 745532 T2087 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368688093257
[junit4:junit4] 2> 745533 T2087 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368688093257/solr.xml
[junit4:junit4] 2> 745533 T2087 oasc.CoreContainer.<init> New CoreContainer 1184646337
[junit4:junit4] 2> 745534 T2087 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368688093257/'
[junit4:junit4] 2> 745535 T2087 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368688093257/'
[junit4:junit4] 2> 745652 T2087 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 745653 T2087 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 745653 T2087 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 745654 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 745654 T2087 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 745655 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 745655 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 745656 T2087 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 745657 T2087 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 745657 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 745672 T2087 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 745672 T2087 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53707/solr
[junit4:junit4] 2> 745673 T2087 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 745674 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 745677 T2127 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@252cf4ae name:ZooKeeperConnection Watcher:127.0.0.1:53707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 745678 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 745695 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 745706 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 745708 T2129 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@272e5d06 name:ZooKeeperConnection Watcher:127.0.0.1:53707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 745708 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 745719 T2087 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 746722 T2087 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53714_tg_hv%2Fk
[junit4:junit4] 2> 746750 T2087 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53714_tg_hv%2Fk
[junit4:junit4] 2> 746753 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 746754 T2129 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 746754 T2116 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 746756 T2109 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 746762 T2130 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368688093257/collection1
[junit4:junit4] 2> 746762 T2130 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 746763 T2130 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 746763 T2130 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 746765 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 746765 T2130 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368688093257/collection1/'
[junit4:junit4] 2> 746766 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53710_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53710/tg_hv/k"}
[junit4:junit4] 2> 746766 T2130 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368688093257/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 746767 T2130 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368688093257/collection1/lib/README' to classloader
[junit4:junit4] 2> 746778 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 746778 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 746778 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 746818 T2130 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 746878 T2130 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 746980 T2130 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 746985 T2130 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 747558 T2130 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 747563 T2130 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 747565 T2130 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 747570 T2130 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 747597 T2130 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 747597 T2130 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368688093257/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty1/
[junit4:junit4] 2> 747597 T2130 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6efc82
[junit4:junit4] 2> 747598 T2130 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 747599 T2130 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty1
[junit4:junit4] 2> 747599 T2130 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty1/index/
[junit4:junit4] 2> 747599 T2130 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 747600 T2130 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty1/index
[junit4:junit4] 2> 747603 T2130 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@19cbae81 lockFactory=org.apache.lucene.store.NativeFSLockFactory@689a5e42),segFN=segments_1,generation=1}
[junit4:junit4] 2> 747604 T2130 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 747607 T2130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 747607 T2130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 747608 T2130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 747609 T2130 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 747609 T2130 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 747609 T2130 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 747610 T2130 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 747611 T2130 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 747611 T2130 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 747624 T2130 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 747630 T2130 oass.SolrIndexSearcher.<init> Opening Searcher@60df72f8 main
[junit4:junit4] 2> 747630 T2130 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty1/tlog
[junit4:junit4] 2> 747631 T2130 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 747631 T2130 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 747636 T2131 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60df72f8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 747638 T2130 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 747638 T2130 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 748284 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 748284 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53714_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53714/tg_hv/k"}
[junit4:junit4] 2> 748285 T2110 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 748285 T2110 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 748329 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 748329 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 748329 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 748669 T2130 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 748669 T2130 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53714/tg_hv/k collection:collection1 shard:shard1
[junit4:junit4] 2> 748670 T2130 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 748690 T2130 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 748702 T2130 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 748702 T2130 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 748702 T2130 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53714/tg_hv/k/collection1/
[junit4:junit4] 2> 748702 T2130 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 748703 T2130 oasc.SyncStrategy.syncToMe http://127.0.0.1:53714/tg_hv/k/collection1/ has no replicas
[junit4:junit4] 2> 748703 T2130 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53714/tg_hv/k/collection1/
[junit4:junit4] 2> 748703 T2130 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 749834 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 749859 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 749859 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 749859 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 749890 T2130 oasc.ZkController.register We are http://127.0.0.1:53714/tg_hv/k/collection1/ and leader is http://127.0.0.1:53714/tg_hv/k/collection1/
[junit4:junit4] 2> 749890 T2130 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53714/tg_hv/k
[junit4:junit4] 2> 749890 T2130 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 749890 T2130 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 749891 T2130 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 749893 T2130 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 749895 T2087 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 749895 T2087 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 749896 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 750150 T2087 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 750153 T2087 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:53719
[junit4:junit4] 2> 750154 T2087 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 750155 T2087 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 750155 T2087 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368688097856
[junit4:junit4] 2> 750156 T2087 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368688097856/solr.xml
[junit4:junit4] 2> 750156 T2087 oasc.CoreContainer.<init> New CoreContainer 1573154372
[junit4:junit4] 2> 750157 T2087 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368688097856/'
[junit4:junit4] 2> 750158 T2087 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368688097856/'
[junit4:junit4] 2> 750288 T2087 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 750289 T2087 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 750289 T2087 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 750290 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 750290 T2087 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 750291 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 750291 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 750292 T2087 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 750292 T2087 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 750293 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 750309 T2087 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 750310 T2087 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53707/solr
[junit4:junit4] 2> 750311 T2087 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 750312 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 750315 T2143 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4653ac83 name:ZooKeeperConnection Watcher:127.0.0.1:53707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 750316 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 750330 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 750342 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 750345 T2145 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7156a80a name:ZooKeeperConnection Watcher:127.0.0.1:53707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 750345 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 750357 T2087 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 751361 T2087 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53719_tg_hv%2Fk
[junit4:junit4] 2> 751364 T2087 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53719_tg_hv%2Fk
[junit4:junit4] 2> 751367 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 751368 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 751367 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 751368 T2145 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 751368 T2129 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 751369 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53714_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53714/tg_hv/k"}
[junit4:junit4] 2> 751369 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 751370 T2116 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 751446 T2146 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368688097856/collection1
[junit4:junit4] 2> 751447 T2146 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 751470 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 751471 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 751471 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 751471 T2146 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 751472 T2146 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 751492 T2146 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368688097856/collection1/'
[junit4:junit4] 2> 751493 T2109 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 751494 T2146 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368688097856/collection1/lib/README' to classloader
[junit4:junit4] 2> 751494 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 751494 T2146 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368688097856/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 751536 T2146 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 751585 T2146 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 751686 T2146 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 751692 T2146 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 752303 T2146 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 752307 T2146 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 752310 T2146 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 752316 T2146 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 752342 T2146 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 752342 T2146 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368688097856/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty2/
[junit4:junit4] 2> 752343 T2146 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6efc82
[junit4:junit4] 2> 752343 T2146 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 752344 T2146 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty2
[junit4:junit4] 2> 752344 T2146 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty2/index/
[junit4:junit4] 2> 752345 T2146 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 752346 T2146 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty2/index
[junit4:junit4] 2> 752349 T2146 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@448e8a86 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b7cbbd8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 752349 T2146 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 752353 T2146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 752353 T2146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 752354 T2146 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 752355 T2146 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 752355 T2146 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 752356 T2146 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 752356 T2146 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 752357 T2146 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 752357 T2146 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 752370 T2146 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 752376 T2146 oass.SolrIndexSearcher.<init> Opening Searcher@2f2ec808 main
[junit4:junit4] 2> 752376 T2146 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty2/tlog
[junit4:junit4] 2> 752377 T2146 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 752378 T2146 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 752383 T2147 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f2ec808 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 752385 T2146 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 752385 T2146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 752994 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 752995 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53719_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53719/tg_hv/k"}
[junit4:junit4] 2> 752996 T2110 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 752996 T2110 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 753034 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 753034 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 753034 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 753034 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 753389 T2146 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 753389 T2146 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53719/tg_hv/k collection:collection1 shard:shard2
[junit4:junit4] 2> 753390 T2146 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 753406 T2146 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 753415 T2146 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 753415 T2146 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 753415 T2146 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53719/tg_hv/k/collection1/
[junit4:junit4] 2> 753415 T2146 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 753415 T2146 oasc.SyncStrategy.syncToMe http://127.0.0.1:53719/tg_hv/k/collection1/ has no replicas
[junit4:junit4] 2> 753416 T2146 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53719/tg_hv/k/collection1/
[junit4:junit4] 2> 753416 T2146 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 754540 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 754566 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 754566 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 754566 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 754566 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 754602 T2146 oasc.ZkController.register We are http://127.0.0.1:53719/tg_hv/k/collection1/ and leader is http://127.0.0.1:53719/tg_hv/k/collection1/
[junit4:junit4] 2> 754602 T2146 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53719/tg_hv/k
[junit4:junit4] 2> 754602 T2146 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 754602 T2146 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 754603 T2146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 754605 T2146 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 754606 T2087 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 754607 T2087 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 754607 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 754879 T2087 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 754883 T2087 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:53722
[junit4:junit4] 2> 754883 T2087 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 754884 T2087 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 754884 T2087 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368688102569
[junit4:junit4] 2> 754885 T2087 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368688102569/solr.xml
[junit4:junit4] 2> 754886 T2087 oasc.CoreContainer.<init> New CoreContainer 495647989
[junit4:junit4] 2> 754886 T2087 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368688102569/'
[junit4:junit4] 2> 754887 T2087 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368688102569/'
[junit4:junit4] 2> 755043 T2087 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 755044 T2087 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 755044 T2087 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 755045 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 755045 T2087 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 755046 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 755046 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 755047 T2087 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 755047 T2087 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 755048 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 755067 T2087 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 755067 T2087 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53707/solr
[junit4:junit4] 2> 755068 T2087 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 755069 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 755072 T2159 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4327b91f name:ZooKeeperConnection Watcher:127.0.0.1:53707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 755072 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 755074 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 755087 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 755089 T2161 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66eb6228 name:ZooKeeperConnection Watcher:127.0.0.1:53707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 755089 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 755101 T2087 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 756073 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 756074 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53719_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53719/tg_hv/k"}
[junit4:junit4] 2> 756080 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 756080 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 756080 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 756080 T2161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 756080 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 756104 T2087 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53722_tg_hv%2Fk
[junit4:junit4] 2> 756106 T2087 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53722_tg_hv%2Fk
[junit4:junit4] 2> 756109 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 756109 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 756110 T2129 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 756109 T2161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 756110 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 756110 T2145 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 756111 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 756111 T2116 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 756112 T2109 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 756113 T2161 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 756119 T2162 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368688102569/collection1
[junit4:junit4] 2> 756119 T2162 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 756120 T2162 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 756120 T2162 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 756122 T2162 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368688102569/collection1/'
[junit4:junit4] 2> 756124 T2162 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368688102569/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 756124 T2162 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368688102569/collection1/lib/README' to classloader
[junit4:junit4] 2> 756180 T2162 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 756247 T2162 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 756349 T2162 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 756355 T2162 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 756953 T2162 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 756956 T2162 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 756957 T2162 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 756962 T2162 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 756983 T2162 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 756983 T2162 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368688102569/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3/
[junit4:junit4] 2> 756984 T2162 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6efc82
[junit4:junit4] 2> 756984 T2162 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 756985 T2162 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3
[junit4:junit4] 2> 756985 T2162 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3/index/
[junit4:junit4] 2> 756985 T2162 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 756986 T2162 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3/index
[junit4:junit4] 2> 756988 T2162 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79f15cbf lockFactory=org.apache.lucene.store.NativeFSLockFactory@5094f334),segFN=segments_1,generation=1}
[junit4:junit4] 2> 756988 T2162 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 756991 T2162 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 756991 T2162 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 756991 T2162 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 756992 T2162 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 756992 T2162 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 756993 T2162 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 756993 T2162 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 756993 T2162 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 756994 T2162 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 757001 T2162 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 757005 T2162 oass.SolrIndexSearcher.<init> Opening Searcher@48bd8916 main
[junit4:junit4] 2> 757006 T2162 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3/tlog
[junit4:junit4] 2> 757006 T2162 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 757007 T2162 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 757010 T2163 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48bd8916 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 757012 T2162 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 757012 T2162 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 757587 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 757588 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53722_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53722/tg_hv/k"}
[junit4:junit4] 2> 757588 T2110 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 757588 T2110 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 757594 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 757594 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 757594 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 757594 T2161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 757594 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 758015 T2162 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 758015 T2162 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53722/tg_hv/k collection:collection1 shard:shard1
[junit4:junit4] 2> 758019 T2162 oasc.ZkController.register We are http://127.0.0.1:53722/tg_hv/k/collection1/ and leader is http://127.0.0.1:53714/tg_hv/k/collection1/
[junit4:junit4] 2> 758019 T2162 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53722/tg_hv/k
[junit4:junit4] 2> 758019 T2162 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 758019 T2162 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C99 name=collection1 org.apache.solr.core.SolrCore@60e05dfd url=http://127.0.0.1:53722/tg_hv/k/collection1 node=127.0.0.1:53722_tg_hv%2Fk C99_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53722_tg_hv%2Fk, base_url=http://127.0.0.1:53722/tg_hv/k}
[junit4:junit4] 2> 758020 T2164 C99 P53722 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 758020 T2162 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 758021 T2164 C99 P53722 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 758021 T2164 C99 P53722 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 758021 T2164 C99 P53722 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 758022 T2087 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 758022 T2087 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 758023 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 758023 T2164 C99 P53722 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 758040 T2119 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 758189 T2087 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 758192 T2087 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:53726
[junit4:junit4] 2> 758193 T2087 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 758193 T2087 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 758193 T2087 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368688105981
[junit4:junit4] 2> 758194 T2087 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368688105981/solr.xml
[junit4:junit4] 2> 758194 T2087 oasc.CoreContainer.<init> New CoreContainer 1518518338
[junit4:junit4] 2> 758195 T2087 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368688105981/'
[junit4:junit4] 2> 758195 T2087 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368688105981/'
[junit4:junit4] 2> 758278 T2087 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 758279 T2087 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 758279 T2087 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 758280 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 758280 T2087 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 758280 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 758281 T2087 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 758281 T2087 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 758281 T2087 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 758282 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 758291 T2087 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 758292 T2087 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53707/solr
[junit4:junit4] 2> 758292 T2087 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 758293 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 758296 T2176 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b5880d9 name:ZooKeeperConnection Watcher:127.0.0.1:53707 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 758296 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 758298 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 758305 T2087 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 758307 T2178 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1988734 name:ZooKeeperConnection Watcher:127.0.0.1:53707/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 758307 T2087 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 758311 T2087 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 759105 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 759106 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53722_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53722/tg_hv/k"}
[junit4:junit4] 2> 759120 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 759120 T2161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 759120 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 759120 T2178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 759120 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 759120 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 759314 T2087 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53726_tg_hv%2Fk
[junit4:junit4] 2> 759316 T2087 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53726_tg_hv%2Fk
[junit4:junit4] 2> 759319 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 759319 T2161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 759319 T2145 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 759319 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 759320 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 759319 T2178 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 759319 T2129 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 759321 T2161 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 759321 T2116 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 759321 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 759321 T2178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 759328 T2109 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 759334 T2179 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368688105981/collection1
[junit4:junit4] 2> 759334 T2179 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 759335 T2179 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 759335 T2179 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 759336 T2179 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368688105981/collection1/'
[junit4:junit4] 2> 759337 T2179 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368688105981/collection1/lib/README' to classloader
[junit4:junit4] 2> 759338 T2179 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368688105981/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 759382 T2179 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 759444 T2179 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 759545 T2179 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 759551 T2179 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 760042 T2119 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 760042 T2119 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:53722_tg_hv%252Fk&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 760181 T2179 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 760185 T2179 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 760188 T2179 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 760194 T2179 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 760218 T2179 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 760219 T2179 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368688105981/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/
[junit4:junit4] 2> 760219 T2179 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6efc82
[junit4:junit4] 2> 760220 T2179 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 760220 T2179 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4
[junit4:junit4] 2> 760221 T2179 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index/
[junit4:junit4] 2> 760221 T2179 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 760222 T2179 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index
[junit4:junit4] 2> 760225 T2179 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5cfe02a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65270606),segFN=segments_1,generation=1}
[junit4:junit4] 2> 760226 T2179 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 760229 T2179 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 760229 T2179 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 760230 T2179 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 760231 T2179 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 760231 T2179 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 760232 T2179 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 760232 T2179 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 760233 T2179 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 760233 T2179 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 760248 T2179 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 760255 T2179 oass.SolrIndexSearcher.<init> Opening Searcher@7e2c4e62 main
[junit4:junit4] 2> 760255 T2179 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/tlog
[junit4:junit4] 2> 760256 T2179 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 760256 T2179 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 760261 T2180 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7e2c4e62 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 760264 T2179 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 760264 T2179 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 760626 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 760627 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53726_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53726/tg_hv/k"}
[junit4:junit4] 2> 760627 T2110 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 760627 T2110 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 760639 T2178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 760639 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 760639 T2161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 760639 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 760639 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 760639 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 761268 T2179 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 761268 T2179 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53726/tg_hv/k collection:collection1 shard:shard2
[junit4:junit4] 2> 761275 T2179 oasc.ZkController.register We are http://127.0.0.1:53726/tg_hv/k/collection1/ and leader is http://127.0.0.1:53719/tg_hv/k/collection1/
[junit4:junit4] 2> 761275 T2179 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53726/tg_hv/k
[junit4:junit4] 2> 761276 T2179 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 761276 T2179 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C100 name=collection1 org.apache.solr.core.SolrCore@33dc6d33 url=http://127.0.0.1:53726/tg_hv/k/collection1 node=127.0.0.1:53726_tg_hv%2Fk C100_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53726_tg_hv%2Fk, base_url=http://127.0.0.1:53726/tg_hv/k}
[junit4:junit4] 2> 761276 T2181 C100 P53726 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 761277 T2179 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 761277 T2181 C100 P53726 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 761278 T2181 C100 P53726 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 761278 T2181 C100 P53726 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 761279 T2087 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 761279 T2087 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 761280 T2087 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 761280 T2181 C100 P53726 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 761294 T2087 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 761296 T2087 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 761296 T2135 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 761296 T2087 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 761297 T2087 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C99_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53722_tg_hv%2Fk, base_url=http://127.0.0.1:53722/tg_hv/k}
[junit4:junit4] 2> 762045 T2164 C99 P53722 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53714/tg_hv/k/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 762045 T2164 C99 P53722 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53722/tg_hv/k START replicas=[http://127.0.0.1:53714/tg_hv/k/collection1/] nUpdates=100
[junit4:junit4] 2> 762046 T2164 C99 P53722 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 762046 T2164 C99 P53722 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 762046 T2164 C99 P53722 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 762047 T2164 C99 P53722 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 762047 T2164 C99 P53722 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 762047 T2164 C99 P53722 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53714/tg_hv/k/collection1/. core=collection1
[junit4:junit4] 2> 762047 T2164 C99 P53722 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C101 name=collection1 org.apache.solr.core.SolrCore@3408b8e url=http://127.0.0.1:53714/tg_hv/k/collection1 node=127.0.0.1:53714_tg_hv%2Fk C101_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53714_tg_hv%2Fk, base_url=http://127.0.0.1:53714/tg_hv/k, leader=true}
[junit4:junit4] 2> 762056 T2120 C101 P53714 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 762057 T2121 C101 P53714 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 762059 T2121 C101 P53714 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@19cbae81 lockFactory=org.apache.lucene.store.NativeFSLockFactory@689a5e42),segFN=segments_1,generation=1}
[junit4:junit4] 2> 762059 T2121 C101 P53714 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 762060 T2121 C101 P53714 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@19cbae81 lockFactory=org.apache.lucene.store.NativeFSLockFactory@689a5e42),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@19cbae81 lockFactory=org.apache.lucene.store.NativeFSLockFactory@689a5e42),segFN=segments_2,generation=2}
[junit4:junit4] 2> 762060 T2121 C101 P53714 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 762060 T2121 C101 P53714 oass.SolrIndexSearcher.<init> Opening Searcher@75c0e3db realtime
[junit4:junit4] 2> 762061 T2121 C101 P53714 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 762061 T2121 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 762062 T2164 C99 P53722 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 762062 T2164 C99 P53722 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 762064 T2122 C101 P53714 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 762064 T2122 C101 P53714 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 762064 T2164 C99 P53722 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 762064 T2164 C99 P53722 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 762065 T2164 C99 P53722 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 762067 T2122 C101 P53714 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 762068 T2164 C99 P53722 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 762069 T2164 C99 P53722 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3/index.20130516040830011
[junit4:junit4] 2> 762070 T2164 C99 P53722 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@662f2813 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5fb0bb91) fullCopy=false
[junit4:junit4] 2> 762072 T2122 C101 P53714 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 762073 T2164 C99 P53722 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 762074 T2164 C99 P53722 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 762074 T2164 C99 P53722 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 762076 T2164 C99 P53722 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79f15cbf lockFactory=org.apache.lucene.store.NativeFSLockFactory@5094f334),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79f15cbf lockFactory=org.apache.lucene.store.NativeFSLockFactory@5094f334),segFN=segments_2,generation=2}
[junit4:junit4] 2> 762076 T2164 C99 P53722 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 762076 T2164 C99 P53722 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 762076 T2164 C99 P53722 oass.SolrIndexSearcher.<init> Opening Searcher@35cbdd0b main
[junit4:junit4] 2> 762078 T2163 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@35cbdd0b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 762078 T2164 C99 P53722 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3/index.20130516040830011 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3/index.20130516040830011;done=true>>]
[junit4:junit4] 2> 762078 T2164 C99 P53722 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3/index.20130516040830011
[junit4:junit4] 2> 762079 T2164 C99 P53722 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty3/index.20130516040830011
[junit4:junit4] 2> 762079 T2164 C99 P53722 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 762079 T2164 C99 P53722 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 762079 T2164 C99 P53722 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 762079 T2164 C99 P53722 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 762082 T2164 C99 P53722 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 762145 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 762146 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53726_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53726/tg_hv/k"}
[junit4:junit4] 2> 762154 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53722_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53722/tg_hv/k"}
[junit4:junit4] 2> 762165 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 762165 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 762165 T2161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 762165 T2178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 762165 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 762165 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 762297 T2135 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 762297 T2135 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:53726_tg_hv%252Fk&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 762299 T2087 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 763301 T2087 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C100_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53726_tg_hv%2Fk, base_url=http://127.0.0.1:53726/tg_hv/k}
[junit4:junit4] 2> 764299 T2181 C100 P53726 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53719/tg_hv/k/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 764299 T2181 C100 P53726 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53726/tg_hv/k START replicas=[http://127.0.0.1:53719/tg_hv/k/collection1/] nUpdates=100
[junit4:junit4] 2> 764300 T2181 C100 P53726 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 764300 T2181 C100 P53726 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 764300 T2181 C100 P53726 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 764300 T2181 C100 P53726 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 764301 T2181 C100 P53726 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 764301 T2181 C100 P53726 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53719/tg_hv/k/collection1/. core=collection1
[junit4:junit4] 2> 764301 T2181 C100 P53726 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 764304 T2087 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C102 name=collection1 org.apache.solr.core.SolrCore@7f8f8016 url=http://127.0.0.1:53719/tg_hv/k/collection1 node=127.0.0.1:53719_tg_hv%2Fk C102_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53719_tg_hv%2Fk, base_url=http://127.0.0.1:53719/tg_hv/k, leader=true}
[junit4:junit4] 2> 764310 T2136 C102 P53719 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 764313 T2137 C102 P53719 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 764316 T2137 C102 P53719 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@448e8a86 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b7cbbd8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 764316 T2137 C102 P53719 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 764317 T2137 C102 P53719 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@448e8a86 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b7cbbd8),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@448e8a86 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b7cbbd8),segFN=segments_2,generation=2}
[junit4:junit4] 2> 764318 T2137 C102 P53719 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 764318 T2137 C102 P53719 oass.SolrIndexSearcher.<init> Opening Searcher@146b1e56 realtime
[junit4:junit4] 2> 764319 T2137 C102 P53719 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 764319 T2137 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 764320 T2181 C100 P53726 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 764320 T2181 C100 P53726 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 764322 T2138 C102 P53719 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 764323 T2138 C102 P53719 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 764324 T2181 C100 P53726 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 764324 T2181 C100 P53726 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 764324 T2181 C100 P53726 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 764326 T2138 C102 P53719 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 764327 T2181 C100 P53726 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 764328 T2181 C100 P53726 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index.20130516040832271
[junit4:junit4] 2> 764328 T2181 C100 P53726 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@41d934f4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cdf3800) fullCopy=false
[junit4:junit4] 2> 764331 T2138 C102 P53719 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 764332 T2181 C100 P53726 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 764333 T2181 C100 P53726 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 764334 T2181 C100 P53726 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 764335 T2181 C100 P53726 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5cfe02a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65270606),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5cfe02a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65270606),segFN=segments_2,generation=2}
[junit4:junit4] 2> 764336 T2181 C100 P53726 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 764336 T2181 C100 P53726 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 764336 T2181 C100 P53726 oass.SolrIndexSearcher.<init> Opening Searcher@26903d4d main
[junit4:junit4] 2> 764338 T2180 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@26903d4d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 764339 T2181 C100 P53726 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index.20130516040832271 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index.20130516040832271;done=true>>]
[junit4:junit4] 2> 764339 T2181 C100 P53726 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index.20130516040832271
[junit4:junit4] 2> 764339 T2181 C100 P53726 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index.20130516040832271
[junit4:junit4] 2> 764340 T2181 C100 P53726 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 764340 T2181 C100 P53726 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 764340 T2181 C100 P53726 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 764340 T2181 C100 P53726 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 764343 T2181 C100 P53726 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 765181 T2110 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 765182 T2110 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53726_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53726/tg_hv/k"}
[junit4:junit4] 2> 765188 T2116 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 765188 T2161 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 765188 T2129 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 765188 T2109 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 765188 T2145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 765188 T2178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 765307 T2087 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 765308 T2087 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C103 name=collection1 org.apache.solr.core.SolrCore@5548958d url=http://127.0.0.1:53710/tg_hv/k/collection1 node=127.0.0.1:53710_tg_hv%2Fk C103_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:53710_tg_hv%2Fk, base_url=http://127.0.0.1:53710/tg_hv/k, leader=true}
[junit4:junit4] 2> 765317 T2099 C103 P53710 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 765321 T2099 C103 P53710 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@70095a0a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3239d2ab),segFN=segments_1,generation=1}
[junit4:junit4] 2> 765321 T2099 C103 P53710 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 765322 T2099 C103 P53710 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@70095a0a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3239d2ab),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@70095a0a lockFactory=org.apache.lucene.store.NativeFSLockFactory@3239d2ab),segFN=segments_2,generation=2}
[junit4:junit4] 2> 765323 T2099 C103 P53710 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 765323 T2099 C103 P53710 oass.SolrIndexSearcher.<init> Opening Searcher@1984ad7 main
[junit4:junit4] 2> 765324 T2099 C103 P53710 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 765324 T2113 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1984ad7 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 765325 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 765336 T2139 C102 P53719 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 765337 T2139 C102 P53719 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@448e8a86 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b7cbbd8),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@448e8a86 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b7cbbd8),segFN=segments_3,generation=3}
[junit4:junit4] 2> 765338 T2139 C102 P53719 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 765338 T2139 C102 P53719 oass.SolrIndexSearcher.<init> Opening Searcher@40337f6c main
[junit4:junit4] 2> 765338 T2139 C102 P53719 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 765340 T2147 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40337f6c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 765341 T2139 C102 P53719 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:53714/tg_hv/k/collection1/, StdNode: http://127.0.0.1:53722/tg_hv/k/collection1/, StdNode: http://127.0.0.1:53726/tg_hv/k/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 765344 T2123 C101 P53714 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 765345 T2123 C101 P53714 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@19cbae81 lockFactory=org.apache.lucene.store.NativeFSLockFactory@689a5e42),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@19cbae81 lockFactory=org.apache.lucene.store.NativeFSLockFactory@689a5e42),segFN=segments_3,generation=3}
[junit4:junit4] 2> 765345 T2123 C101 P53714 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 765346 T2123 C101 P53714 oass.SolrIndexSearcher.<init> Opening Searcher@59471431 main
[junit4:junit4] 2> 765346 T2123 C101 P53714 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 765347 T2131 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59471431 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 765347 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 2> C99_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53722_tg_hv%2Fk, base_url=http://127.0.0.1:53722/tg_hv/k}
[junit4:junit4] 2> 765352 T2151 C99 P53722 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 765353 T2151 C99 P53722 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79f15cbf lockFactory=org.apache.lucene.store.NativeFSLockFactory@5094f334),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@79f15cbf lockFactory=org.apache.lucene.store.NativeFSLockFactory@5094f334),segFN=segments_3,generation=3}
[junit4:junit4] 2> 765353 T2151 C99 P53722 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 765354 T2151 C99 P53722 oass.SolrIndexSearcher.<init> Opening Searcher@885195 main
[junit4:junit4] 2> 765354 T2151 C99 P53722 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 765355 T2163 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@885195 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> C100_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53726_tg_hv%2Fk, base_url=http://127.0.0.1:53726/tg_hv/k}
[junit4:junit4] 2> 765356 T2168 C100 P53726 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 765356 T2151 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 765357 T2168 C100 P53726 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5cfe02a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65270606),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5cfe02a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65270606),segFN=segments_3,generation=3}
[junit4:junit4] 2> 765358 T2168 C100 P53726 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 765359 T2168 C100 P53726 oass.SolrIndexSearcher.<init> Opening Searcher@49632fc3 main
[junit4:junit4] 2> 765360 T2168 C100 P53726 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 765360 T2180 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49632fc3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 765361 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 765362 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 26
[junit4:junit4] 2> 765363 T2087 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 765366 T2124 C101 P53714 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 765368 T2152 C99 P53722 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 765370 T2140 C102 P53719 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 765372 T2169 C100 P53726 oasc.SolrCore.execute [collection1] webapp=/tg_hv/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 767378 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435173509209784320)} 0 2
[junit4:junit4] 2> 767386 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={update.distrib=FROMLEADER&_version_=-1435173509213978624&update.from=http://127.0.0.1:53714/tg_hv/k/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435173509213978624)} 0 1
[junit4:junit4] 2> 767389 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={update.distrib=FROMLEADER&_version_=-1435173509218172928&update.from=http://127.0.0.1:53719/tg_hv/k/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435173509218172928)} 0 1
[junit4:junit4] 2> 767390 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435173509218172928)} 0 6
[junit4:junit4] 2> 767391 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435173509213978624)} 0 11
[junit4:junit4] 2> 767394 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[0 (1435173509226561536)]} 0 1
[junit4:junit4] 2> 767401 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435173509230755840)]} 0 1
[junit4:junit4] 2> 767401 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[0 (1435173509230755840)]} 0 4
[junit4:junit4] 2> 767405 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[1 (1435173509238095872)]} 0 1
[junit4:junit4] 2> 767413 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435173509244387328)]} 0 0
[junit4:junit4] 2> 767414 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1435173509244387328)]} 0 4
[junit4:junit4] 2> 767415 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[1]} 0 8
[junit4:junit4] 2> 767418 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[2 (1435173509251727360)]} 0 1
[junit4:junit4] 2> 767427 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435173509258018816)]} 0 1
[junit4:junit4] 2> 767427 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1435173509258018816)]} 0 4
[junit4:junit4] 2> 767428 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[2]} 0 8
[junit4:junit4] 2> 767432 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[3 (1435173509266407424)]} 0 1
[junit4:junit4] 2> 767439 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435173509271650304)]} 0 0
[junit4:junit4] 2> 767443 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1435173509271650304)]} 0 7
[junit4:junit4] 2> 767443 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[3]} 0 9
[junit4:junit4] 2> 767447 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[4 (1435173509282136064)]} 0 1
[junit4:junit4] 2> 767455 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435173509288427520)]} 0 0
[junit4:junit4] 2> 767456 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1435173509288427520)]} 0 4
[junit4:junit4] 2> 767457 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[4]} 0 8
[junit4:junit4] 2> 767460 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[5 (1435173509296816128)]} 0 0
[junit4:junit4] 2> 767466 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435173509299961856)]} 0 0
[junit4:junit4] 2> 767467 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[5 (1435173509299961856)]} 0 4
[junit4:junit4] 2> 767471 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[6 (1435173509307301888)]} 0 1
[junit4:junit4] 2> 767476 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435173509310447616)]} 0 0
[junit4:junit4] 2> 767477 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[6 (1435173509310447616)]} 0 4
[junit4:junit4] 2> 767481 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[7 (1435173509317787648)]} 0 1
[junit4:junit4] 2> 767488 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435173509323030528)]} 0 0
[junit4:junit4] 2> 767489 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1435173509323030528)]} 0 4
[junit4:junit4] 2> 767490 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[7]} 0 7
[junit4:junit4] 2> 767493 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[8 (1435173509330370560)]} 0 1
[junit4:junit4] 2> 767502 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435173509336662016)]} 0 1
[junit4:junit4] 2> 767503 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1435173509336662016)]} 0 5
[junit4:junit4] 2> 767503 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[8]} 0 8
[junit4:junit4] 2> 767507 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[9 (1435173509345050624)]} 0 1
[junit4:junit4] 2> 767512 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435173509348196352)]} 0 0
[junit4:junit4] 2> 767513 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[9 (1435173509348196352)]} 0 4
[junit4:junit4] 2> 767517 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[10 (1435173509356584960)]} 0 1
[junit4:junit4] 2> 767527 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435173509362876416)]} 0 1
[junit4:junit4] 2> 767527 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1435173509362876416)]} 0 4
[junit4:junit4] 2> 767528 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[10]} 0 8
[junit4:junit4] 2> 767532 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[11 (1435173509371265024)]} 0 1
[junit4:junit4] 2> 767541 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435173509377556480)]} 0 1
[junit4:junit4] 2> 767541 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1435173509377556480)]} 0 4
[junit4:junit4] 2> 767542 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[11]} 0 8
[junit4:junit4] 2> 767546 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[12 (1435173509385945088)]} 0 1
[junit4:junit4] 2> 767552 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435173509389090816)]} 0 1
[junit4:junit4] 2> 767552 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[12 (1435173509389090816)]} 0 4
[junit4:junit4] 2> 767556 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[13 (1435173509396430848)]} 0 1
[junit4:junit4] 2> 767562 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435173509399576576)]} 0 1
[junit4:junit4] 2> 767563 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[13 (1435173509399576576)]} 0 4
[junit4:junit4] 2> 767566 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[14 (1435173509406916608)]} 0 1
[junit4:junit4] 2> 767572 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435173509410062336)]} 0 1
[junit4:junit4] 2> 767572 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[14 (1435173509410062336)]} 0 4
[junit4:junit4] 2> 767576 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[15 (1435173509417402368)]} 0 1
[junit4:junit4] 2> 767581 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435173509420548096)]} 0 0
[junit4:junit4] 2> 767582 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[15 (1435173509420548096)]} 0 4
[junit4:junit4] 2> 767586 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[16 (1435173509427888128)]} 0 1
[junit4:junit4] 2> 767594 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435173509434179584)]} 0 0
[junit4:junit4] 2> 767595 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[16 (1435173509434179584)]} 0 4
[junit4:junit4] 2> 767596 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[16]} 0 8
[junit4:junit4] 2> 767600 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[17 (1435173509442568192)]} 0 1
[junit4:junit4] 2> 767608 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435173509448859648)]} 0 0
[junit4:junit4] 2> 767609 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1435173509448859648)]} 0 4
[junit4:junit4] 2> 767610 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[17]} 0 8
[junit4:junit4] 2> 767614 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[18 (1435173509457248256)]} 0 1
[junit4:junit4] 2> 767622 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435173509463539712)]} 0 0
[junit4:junit4] 2> 767623 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[18 (1435173509463539712)]} 0 4
[junit4:junit4] 2> 767624 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[18]} 0 8
[junit4:junit4] 2> 767628 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[19 (1435173509471928320)]} 0 1
[junit4:junit4] 2> 767633 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435173509475074048)]} 0 0
[junit4:junit4] 2> 767634 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[19 (1435173509475074048)]} 0 4
[junit4:junit4] 2> 767638 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[20 (1435173509482414080)]} 0 1
[junit4:junit4] 2> 767644 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435173509485559808)]} 0 1
[junit4:junit4] 2> 767645 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[20 (1435173509485559808)]} 0 5
[junit4:junit4] 2> 767649 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[21 (1435173509493948416)]} 0 1
[junit4:junit4] 2> 767655 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435173509498142720)]} 0 1
[junit4:junit4] 2> 767655 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[21 (1435173509498142720)]} 0 4
[junit4:junit4] 2> 767659 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[22 (1435173509505482752)]} 0 0
[junit4:junit4] 2> 767669 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435173509511774208)]} 0 1
[junit4:junit4] 2> 767670 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1435173509511774208)]} 0 5
[junit4:junit4] 2> 767671 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[22]} 0 9
[junit4:junit4] 2> 767674 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[23 (1435173509520162816)]} 0 0
[junit4:junit4] 2> 767682 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435173509526454272)]} 0 1
[junit4:junit4] 2> 767682 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[23 (1435173509526454272)]} 0 4
[junit4:junit4] 2> 767683 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[23]} 0 7
[junit4:junit4] 2> 767687 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[24 (1435173509534842880)]} 0 1
[junit4:junit4] 2> 767694 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435173509537988608)]} 0 1
[junit4:junit4] 2> 767695 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[24 (1435173509537988608)]} 0 5
[junit4:junit4] 2> 767699 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[25 (1435173509546377216)]} 0 1
[junit4:junit4] 2> 767708 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435173509552668672)]} 0 1
[junit4:junit4] 2> 767708 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1435173509552668672)]} 0 4
[junit4:junit4] 2> 767709 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[25]} 0 8
[junit4:junit4] 2> 767712 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[26 (1435173509561057280)]} 0 0
[junit4:junit4] 2> 767721 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435173509567348736)]} 0 0
[junit4:junit4] 2> 767722 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1435173509567348736)]} 0 4
[junit4:junit4] 2> 767723 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[26]} 0 8
[junit4:junit4] 2> 767727 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[27 (1435173509575737344)]} 0 1
[junit4:junit4] 2> 767733 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435173509579931648)]} 0 1
[junit4:junit4] 2> 767735 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[27 (1435173509579931648)]} 0 6
[junit4:junit4] 2> 767740 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[28 (1435173509590417408)]} 0 1
[junit4:junit4] 2> 767748 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435173509594611712)]} 0 1
[junit4:junit4] 2> 767749 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[28 (1435173509594611712)]} 0 5
[junit4:junit4] 2> 767753 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[29 (1435173509603000320)]} 0 1
[junit4:junit4] 2> 767758 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435173509606146048)]} 0 0
[junit4:junit4] 2> 767759 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[29 (1435173509606146048)]} 0 4
[junit4:junit4] 2> 767763 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[30 (1435173509613486080)]} 0 1
[junit4:junit4] 2> 767772 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435173509619777536)]} 0 1
[junit4:junit4] 2> 767772 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[30 (1435173509619777536)]} 0 4
[junit4:junit4] 2> 767773 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[30]} 0 8
[junit4:junit4] 2> 767776 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[31 (1435173509628166144)]} 0 0
[junit4:junit4] 2> 767785 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435173509634457600)]} 0 1
[junit4:junit4] 2> 767785 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[31 (1435173509634457600)]} 0 4
[junit4:junit4] 2> 767786 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[31]} 0 7
[junit4:junit4] 2> 767790 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[32 (1435173509641797632)]} 0 1
[junit4:junit4] 2> 767796 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435173509644943360)]} 0 1
[junit4:junit4] 2> 767797 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[32 (1435173509644943360)]} 0 5
[junit4:junit4] 2> 767801 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[33 (1435173509653331968)]} 0 1
[junit4:junit4] 2> 767809 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435173509659623424)]} 0 0
[junit4:junit4] 2> 767810 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[33 (1435173509659623424)]} 0 4
[junit4:junit4] 2> 767811 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[33]} 0 8
[junit4:junit4] 2> 767815 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[34 (1435173509668012032)]} 0 1
[junit4:junit4] 2> 767821 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1435173509671157760)]} 0 1
[junit4:junit4] 2> 767821 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[34 (1435173509671157760)]} 0 4
[junit4:junit4] 2> 767825 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[35 (1435173509678497792)]} 0 1
[junit4:junit4] 2> 767833 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1435173509684789248)]} 0 0
[junit4:junit4] 2> 767834 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[35 (1435173509684789248)]} 0 4
[junit4:junit4] 2> 767835 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[35]} 0 8
[junit4:junit4] 2> 767839 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[36 (1435173509693177856)]} 0 0
[junit4:junit4] 2> 767847 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1435173509699469312)]} 0 0
[junit4:junit4] 2> 767848 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[36 (1435173509699469312)]} 0 4
[junit4:junit4] 2> 767849 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[36]} 0 8
[junit4:junit4] 2> 767853 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[37 (1435173509707857920)]} 0 1
[junit4:junit4] 2> 767861 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1435173509714149376)]} 0 0
[junit4:junit4] 2> 767862 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[37 (1435173509714149376)]} 0 4
[junit4:junit4] 2> 767863 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[37]} 0 8
[junit4:junit4] 2> 767867 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[38 (1435173509722537984)]} 0 1
[junit4:junit4] 2> 767873 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1435173509725683712)]} 0 1
[junit4:junit4] 2> 767873 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[38 (1435173509725683712)]} 0 4
[junit4:junit4] 2> 767877 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[39 (1435173509733023744)]} 0 1
[junit4:junit4] 2> 767882 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1435173509736169472)]} 0 0
[junit4:junit4] 2> 767883 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[39 (1435173509736169472)]} 0 4
[junit4:junit4] 2> 767887 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[40 (1435173509743509504)]} 0 1
[junit4:junit4] 2> 767896 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1435173509750849536)]} 0 0
[junit4:junit4] 2> 767897 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[40 (1435173509750849536)]} 0 4
[junit4:junit4] 2> 767898 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[40]} 0 8
[junit4:junit4] 2> 767902 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[41 (1435173509759238144)]} 0 1
[junit4:junit4] 2> 767910 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1435173509765529600)]} 0 0
[junit4:junit4] 2> 767911 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[41 (1435173509765529600)]} 0 4
[junit4:junit4] 2> 767912 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[41]} 0 8
[junit4:junit4] 2> 767916 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[42 (1435173509773918208)]} 0 1
[junit4:junit4] 2> 767922 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1435173509777063936)]} 0 1
[junit4:junit4] 2> 767922 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[42 (1435173509777063936)]} 0 4
[junit4:junit4] 2> 767926 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[43 (1435173509784403968)]} 0 1
[junit4:junit4] 2> 767932 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1435173509787549696)]} 0 1
[junit4:junit4] 2> 767932 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[43 (1435173509787549696)]} 0 4
[junit4:junit4] 2> 767936 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[44 (1435173509794889728)]} 0 0
[junit4:junit4] 2> 767942 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1435173509798035456)]} 0 1
[junit4:junit4] 2> 767943 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[44 (1435173509798035456)]} 0 5
[junit4:junit4] 2> 767946 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[45 (1435173509805375488)]} 0 1
[junit4:junit4] 2> 767951 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1435173509808521216)]} 0 0
[junit4:junit4] 2> 767952 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[45 (1435173509808521216)]} 0 4
[junit4:junit4] 2> 767956 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[46 (1435173509815861248)]} 0 1
[junit4:junit4] 2> 767964 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1435173509822152704)]} 0 0
[junit4:junit4] 2> 767965 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[46 (1435173509822152704)]} 0 4
[junit4:junit4] 2> 767966 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[46]} 0 8
[junit4:junit4] 2> 767970 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[47 (1435173509830541312)]} 0 1
[junit4:junit4] 2> 767979 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1435173509837881344)]} 0 0
[junit4:junit4] 2> 767980 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[47 (1435173509837881344)]} 0 4
[junit4:junit4] 2> 767981 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[47]} 0 8
[junit4:junit4] 2> 767985 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[48 (1435173509846269952)]} 0 1
[junit4:junit4] 2> 767993 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1435173509852561408)]} 0 0
[junit4:junit4] 2> 767994 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[48 (1435173509852561408)]} 0 4
[junit4:junit4] 2> 767995 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[48]} 0 8
[junit4:junit4] 2> 767999 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[49 (1435173509860950016)]} 0 1
[junit4:junit4] 2> 768007 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1435173509867241472)]} 0 0
[junit4:junit4] 2> 768008 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[49 (1435173509867241472)]} 0 4
[junit4:junit4] 2> 768009 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[49]} 0 8
[junit4:junit4] 2> 768013 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[50 (1435173509875630080)]} 0 1
[junit4:junit4] 2> 768021 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1435173509881921536)]} 0 0
[junit4:junit4] 2> 768022 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[50 (1435173509881921536)]} 0 4
[junit4:junit4] 2> 768023 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[50]} 0 8
[junit4:junit4] 2> 768027 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[51 (1435173509890310144)]} 0 1
[junit4:junit4] 2> 768035 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1435173509896601600)]} 0 0
[junit4:junit4] 2> 768036 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[51 (1435173509896601600)]} 0 4
[junit4:junit4] 2> 768037 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[51]} 0 8
[junit4:junit4] 2> 768041 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[52 (1435173509904990208)]} 0 1
[junit4:junit4] 2> 768049 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1435173509911281664)]} 0 0
[junit4:junit4] 2> 768050 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[52 (1435173509911281664)]} 0 4
[junit4:junit4] 2> 768051 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[52]} 0 8
[junit4:junit4] 2> 768055 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[53 (1435173509919670272)]} 0 1
[junit4:junit4] 2> 768064 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1435173509927010304)]} 0 0
[junit4:junit4] 2> 768065 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1435173509927010304)]} 0 4
[junit4:junit4] 2> 768066 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[53]} 0 8
[junit4:junit4] 2> 768070 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[54 (1435173509935398912)]} 0 1
[junit4:junit4] 2> 768076 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1435173509938544640)]} 0 1
[junit4:junit4] 2> 768076 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[54 (1435173509938544640)]} 0 4
[junit4:junit4] 2> 768080 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[55 (1435173509945884672)]} 0 1
[junit4:junit4] 2> 768088 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1435173509952176128)]} 0 0
[junit4:junit4] 2> 768089 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[55 (1435173509952176128)]} 0 4
[junit4:junit4] 2> 768090 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[55]} 0 8
[junit4:junit4] 2> 768094 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[56 (1435173509960564736)]} 0 1
[junit4:junit4] 2> 768102 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1435173509965807616)]} 0 1
[junit4:junit4] 2> 768102 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[56 (1435173509965807616)]} 0 4
[junit4:junit4] 2> 768103 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[56]} 0 7
[junit4:junit4] 2> 768106 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[57 (1435173509974196224)]} 0 0
[junit4:junit4] 2> 768114 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1435173509979439104)]} 0 0
[junit4:junit4] 2> 768115 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[57 (1435173509979439104)]} 0 4
[junit4:junit4] 2> 768116 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[57]} 0 7
[junit4:junit4] 2> 768120 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[58 (1435173509987827712)]} 0 1
[junit4:junit4] 2> 768129 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1435173509994119168)]} 0 1
[junit4:junit4] 2> 768129 T2141 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[58 (1435173509994119168)]} 0 4
[junit4:junit4] 2> 768130 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[58]} 0 8
[junit4:junit4] 2> 768133 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[59 (1435173510002507776)]} 0 0
[junit4:junit4] 2> 768142 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1435173510008799232)]} 0 0
[junit4:junit4] 2> 768143 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[59 (1435173510008799232)]} 0 4
[junit4:junit4] 2> 768144 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[59]} 0 8
[junit4:junit4] 2> 768148 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[60 (1435173510017187840)]} 0 1
[junit4:junit4] 2> 768155 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1435173510021382144)]} 0 1
[junit4:junit4] 2> 768155 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[60 (1435173510021382144)]} 0 4
[junit4:junit4] 2> 768158 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[61 (1435173510028722176)]} 0 0
[junit4:junit4] 2> 768165 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1435173510031867904)]} 0 1
[junit4:junit4] 2> 768165 T2125 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[61 (1435173510031867904)]} 0 4
[junit4:junit4] 2> 768169 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[62 (1435173510039207936)]} 0 1
[junit4:junit4] 2> 768175 T2168 C100 P53726 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1435173510042353664)]} 0 1
[junit4:junit4] 2> 768175 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[62 (1435173510042353664)]} 0 4
[junit4:junit4] 2> 768179 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[63 (1435173510049693696)]} 0 1
[junit4:junit4] 2> 768187 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1435173510055985152)]} 0 0
[junit4:junit4] 2> 768188 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[63 (1435173510055985152)]} 0 4
[junit4:junit4] 2> 768189 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[63]} 0 8
[junit4:junit4] 2> 768193 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[64 (1435173510064373760)]} 0 1
[junit4:junit4] 2> 768202 T2153 C99 P53722 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53714/tg_hv/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1435173510071713792)]} 0 0
[junit4:junit4] 2> 768203 T2123 C101 P53714 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={distrib.from=http://127.0.0.1:53719/tg_hv/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[64 (1435173510071713792)]} 0 4
[junit4:junit4] 2> 768204 T2139 C102 P53719 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[64]} 0 8
[junit4:junit4] 2> 768208 T2099 C103 P53710 oasup.LogUpdateProcessor.finish [collection1] webapp=/tg_hv/k path=/update params={wt=javabin&version=2} {add=[65 (1435173510080102400)]
[...truncated too long message...]
"127.0.0.1:53722_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53722/tg_hv/k"}
[junit4:junit4] 2> 975358 T2261 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:53722_tg_hv%2Fk_collection1_shard1_0_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1_0",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":null,
[junit4:junit4] 2> "core":"collection1_shard1_0_replica1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53722_tg_hv%2Fk",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53722/tg_hv/k"}
[junit4:junit4] 2> 975369 T2087 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53726
[junit4:junit4] 2> 975369 T2178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 975369 T2087 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1518518338
[junit4:junit4] 2> 976372 T2087 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 976373 T2087 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 976396 T2087 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@33dc6d33
[junit4:junit4] 2> 976398 T2087 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=662,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 976399 T2087 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 976399 T2087 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 976400 T2087 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 976402 T2087 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 976403 T2087 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 976403 T2087 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4;done=false>>]
[junit4:junit4] 2> 976404 T2087 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4
[junit4:junit4] 2> 976404 T2087 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index;done=false>>]
[junit4:junit4] 2> 976405 T2087 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273/jetty4/index
[junit4:junit4] 2> 976406 T2261 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89698342619054092-127.0.0.1:53726_tg_hv%2Fk-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 976419 T2087 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/tg_hv/k,null}
[junit4:junit4] 2> 976489 T2087 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 976492 T2087 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53707 53707
[junit4:junit4] 2> 976665 T2087 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53710
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368688089273 FAILED !!!!!
[junit4:junit4] 2> 976667 T2087 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 976667 T2087 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53707 53707
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=AAFC73EE92C555A7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ru -Dtests.timezone=America/Argentina/San_Luis -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 235s J0 | ChaosMonkeyShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:53714/tg_hv/k returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([AAFC73EE92C555A7:2B1AFDF6E59A359B]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 976687 T2087 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 235370 T2086 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 977719 T2178 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 977719 T2178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 977719 T2178 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=NestedPulsing), _version_=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ru, timezone=America/Argentina/San_Luis
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=2,free=170667432,total=509607936
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestFastWriter, SolrIndexConfigTest, QueryEqualityTest, TestSolrQueryParserDefaultOperatorResource, TestPhraseSuggestions, TestCollationKeyRangeQueries, TestValueSourceCache, TestCharFilters, ClusterStateTest, SpellPossibilityIteratorTest, TestUniqueKeyFieldResource, AnalysisAfterCoreReloadTest, PreAnalyzedUpdateProcessorTest, RequestHandlersTest, TestUtils, TestAnalyzedSuggestions, TestRandomFaceting, SuggesterFSTTest, TestCSVResponseWriter, TestLMJelinekMercerSimilarityFactory, TestSolrQueryParser, IndexReaderFactoryTest, TestSolrXMLSerializer, QueryParsingTest, ChaosMonkeyNothingIsSafeTest, SpatialFilterTest, SliceStateTest, TestReversedWildcardFilterFactory, TestShardHandlerFactory, TestOmitPositions, LoggingHandlerTest, ResourceLoaderTest, XsltUpdateRequestHandlerTest, TestPseudoReturnFields, TestJmxMonitoredMap, TestDFRSimilarityFactory, UnloadDistributedZkTest, RecoveryZkTest, TestPropInject, DOMUtilTest, TestSchemaNameResource, TestCSVLoader, ShardRoutingTest, TestRandomDVFaceting, RAMDirectoryFactoryTest, DateMathParserTest, TestFastOutputStream, SolrCoreCheckLockOnStartupTest, TestIBSimilarityFactory, TestRangeQuery, TestLazyCores, TestCloudManagedSchema, DistributedSpellCheckComponentTest, BinaryUpdateRequestHandlerTest, SignatureUpdateProcessorFactoryTest, TestCoreContainer, SolrCmdDistributorTest, TestMergePolicyConfig, TestRemoteStreaming, TestSchemaResource, UpdateRequestProcessorFactoryTest, PreAnalyzedFieldTest, CurrencyFieldOpenExchangeTest, HighlighterConfigTest, TestRecovery, TestSolrIndexConfig, TestFieldTypeCollectionResource, CircularListTest, SolrRequestParserTest, EchoParamsTest, TestQueryUtils, LeaderElectionTest, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 236.66s, 1 test, 1 error <<< FAILURES!
[...truncated 470 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 27 ignored (8 assumptions)
Total time: 48 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1251 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1251/
1 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:12718/_ returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:12718/_ returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([5313B44CCF98DE0A:D2F53A54B8C7BE36]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9285 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 241706 T739 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_/
[junit4:junit4] 2> 241713 T739 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1368670447387
[junit4:junit4] 2> 241714 T739 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 241715 T740 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 241816 T739 oasc.ZkTestServer.run start zk server on port:12704
[junit4:junit4] 2> 241817 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 241822 T746 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@622df18c name:ZooKeeperConnection Watcher:127.0.0.1:12704 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 241822 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 241822 T739 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 241827 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 241836 T748 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28acfed1 name:ZooKeeperConnection Watcher:127.0.0.1:12704/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 241837 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 241837 T739 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 241842 T739 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 241845 T739 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 241849 T739 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 241854 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 241854 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 241868 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 241869 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 241975 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 241976 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 241985 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 241986 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 241990 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 241990 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 241994 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 241995 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 241999 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 242000 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 242004 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 242004 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 242008 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 242009 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 242244 T739 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 242250 T739 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:12707
[junit4:junit4] 2> 242251 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 242251 T739 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 242252 T739 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368670447688
[junit4:junit4] 2> 242252 T739 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368670447688/solr.xml
[junit4:junit4] 2> 242253 T739 oasc.CoreContainer.<init> New CoreContainer 574445059
[junit4:junit4] 2> 242254 T739 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368670447688/'
[junit4:junit4] 2> 242254 T739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368670447688/'
[junit4:junit4] 2> 242378 T739 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 242379 T739 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 242380 T739 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 242380 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 242381 T739 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 242381 T739 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 242382 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 242382 T739 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 242383 T739 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 242383 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 242399 T739 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 242400 T739 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:12704/solr
[junit4:junit4] 2> 242401 T739 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 242402 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242405 T759 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e09e5b6 name:ZooKeeperConnection Watcher:127.0.0.1:12704 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242405 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242408 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 242420 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242423 T761 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f4ab86f name:ZooKeeperConnection Watcher:127.0.0.1:12704/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242423 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242425 T739 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 242436 T739 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 242441 T739 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 242444 T739 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:12707__
[junit4:junit4] 2> 242446 T739 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:12707__
[junit4:junit4] 2> 242457 T739 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 242470 T739 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 242474 T739 oasc.Overseer.start Overseer (id=89697186440347651-127.0.0.1:12707__-n_0000000000) starting
[junit4:junit4] 2> 242486 T739 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 242497 T763 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 242497 T739 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 242503 T739 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 242509 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 242517 T764 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368670447688/collection1
[junit4:junit4] 2> 242517 T762 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 242517 T764 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 242518 T764 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 242518 T764 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 242520 T764 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368670447688/collection1/'
[junit4:junit4] 2> 242522 T764 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1368670447688/collection1/lib/README' to classloader
[junit4:junit4] 2> 242522 T764 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1368670447688/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 242575 T764 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 242637 T764 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 242739 T764 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 242746 T764 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 243388 T764 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 243392 T764 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 243395 T764 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 243401 T764 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 243449 T764 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 243450 T764 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368670447688/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368670447386/control/data/
[junit4:junit4] 2> 243450 T764 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6222053a
[junit4:junit4] 2> 243451 T764 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 243452 T764 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/control/data
[junit4:junit4] 2> 243452 T764 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368670447386/control/data/index/
[junit4:junit4] 2> 243452 T764 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368670447386/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 243453 T764 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/control/data/index
[junit4:junit4] 2> 243457 T764 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a3b4ac6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dc49080),segFN=segments_1,generation=1}
[junit4:junit4] 2> 243457 T764 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 243460 T764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 243460 T764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 243461 T764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 243462 T764 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 243462 T764 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 243463 T764 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 243463 T764 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 243464 T764 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 243464 T764 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 243477 T764 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 243493 T764 oass.SolrIndexSearcher.<init> Opening Searcher@6e4a1347 main
[junit4:junit4] 2> 243493 T764 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368670447386/control/data/tlog
[junit4:junit4] 2> 243494 T764 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 243495 T764 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 243499 T765 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e4a1347 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 243502 T764 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 243502 T764 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 244022 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 244023 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12707__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12707/_"}
[junit4:junit4] 2> 244024 T762 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 244028 T762 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 244051 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 244527 T764 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 244527 T764 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:12707/_ collection:control_collection shard:shard1
[junit4:junit4] 2> 244528 T764 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 244538 T764 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 244541 T764 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 244542 T764 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 244542 T764 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:12707/_/collection1/
[junit4:junit4] 2> 244542 T764 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 244542 T764 oasc.SyncStrategy.syncToMe http://127.0.0.1:12707/_/collection1/ has no replicas
[junit4:junit4] 2> 244543 T764 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:12707/_/collection1/
[junit4:junit4] 2> 244543 T764 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 245583 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 245600 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 245622 T764 oasc.ZkController.register We are http://127.0.0.1:12707/_/collection1/ and leader is http://127.0.0.1:12707/_/collection1/
[junit4:junit4] 2> 245622 T764 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:12707/_
[junit4:junit4] 2> 245622 T764 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 245622 T764 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 245623 T764 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 245625 T764 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 245626 T739 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 245627 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 245628 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 245647 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 245653 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 245657 T768 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5648b73d name:ZooKeeperConnection Watcher:127.0.0.1:12704/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 245658 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 245659 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 245665 T739 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 245892 T739 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 245895 T739 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:12718
[junit4:junit4] 2> 245896 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 245897 T739 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 245897 T739 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368670451338
[junit4:junit4] 2> 245897 T739 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368670451338/solr.xml
[junit4:junit4] 2> 245898 T739 oasc.CoreContainer.<init> New CoreContainer 1041644613
[junit4:junit4] 2> 245899 T739 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368670451338/'
[junit4:junit4] 2> 245899 T739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368670451338/'
[junit4:junit4] 2> 246015 T739 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 246016 T739 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 246017 T739 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 246017 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 246017 T739 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 246018 T739 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 246018 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 246019 T739 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 246019 T739 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 246020 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 246038 T739 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 246039 T739 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:12704/solr
[junit4:junit4] 2> 246039 T739 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 246040 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 246043 T779 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c6537fb name:ZooKeeperConnection Watcher:127.0.0.1:12704 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 246044 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 246057 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 246071 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 246073 T781 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6711addb name:ZooKeeperConnection Watcher:127.0.0.1:12704/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 246074 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 246084 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 247089 T739 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:12718__
[junit4:junit4] 2> 247092 T739 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:12718__
[junit4:junit4] 2> 247096 T761 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 247096 T768 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 247096 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 247096 T781 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 247104 T782 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368670451338/collection1
[junit4:junit4] 2> 247105 T782 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 247106 T782 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 247106 T782 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 247108 T782 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368670451338/collection1/'
[junit4:junit4] 2> 247109 T782 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1368670451338/collection1/lib/README' to classloader
[junit4:junit4] 2> 247110 T782 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1368670451338/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 247115 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 247116 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:12707___collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12707__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12707/_"}
[junit4:junit4] 2> 247135 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 247135 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 247135 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 247175 T782 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 247236 T782 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 247337 T782 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 247344 T782 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 247944 T782 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 247948 T782 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 247951 T782 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 247957 T782 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 247992 T782 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 247992 T782 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368670451338/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty1/
[junit4:junit4] 2> 247993 T782 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6222053a
[junit4:junit4] 2> 247993 T782 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 247994 T782 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty1
[junit4:junit4] 2> 247994 T782 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty1/index/
[junit4:junit4] 2> 247995 T782 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 247995 T782 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty1/index
[junit4:junit4] 2> 247999 T782 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@35d9668a lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b82f569),segFN=segments_1,generation=1}
[junit4:junit4] 2> 247999 T782 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 248002 T782 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 248003 T782 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 248004 T782 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 248004 T782 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 248005 T782 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 248005 T782 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 248006 T782 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 248007 T782 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 248007 T782 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 248020 T782 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 248026 T782 oass.SolrIndexSearcher.<init> Opening Searcher@5db871b7 main
[junit4:junit4] 2> 248027 T782 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty1/tlog
[junit4:junit4] 2> 248028 T782 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 248028 T782 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 248033 T783 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5db871b7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 248037 T782 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 248037 T782 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 248647 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 248648 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12718__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12718/_"}
[junit4:junit4] 2> 248649 T762 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 248649 T762 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 248661 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 248662 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 248661 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 249041 T782 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 249041 T782 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:12718/_ collection:collection1 shard:shard1
[junit4:junit4] 2> 249043 T782 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 249102 T782 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 249131 T782 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 249132 T782 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 249132 T782 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:12718/_/collection1/
[junit4:junit4] 2> 249132 T782 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 249133 T782 oasc.SyncStrategy.syncToMe http://127.0.0.1:12718/_/collection1/ has no replicas
[junit4:junit4] 2> 249133 T782 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:12718/_/collection1/
[junit4:junit4] 2> 249133 T782 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 250167 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 250208 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 250208 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 250208 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 250212 T782 oasc.ZkController.register We are http://127.0.0.1:12718/_/collection1/ and leader is http://127.0.0.1:12718/_/collection1/
[junit4:junit4] 2> 250212 T782 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:12718/_
[junit4:junit4] 2> 250212 T782 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 250212 T782 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 250212 T782 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 250221 T782 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 250222 T739 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 250223 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 250223 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 250381 T739 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 250384 T739 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:12722
[junit4:junit4] 2> 250385 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 250385 T739 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 250385 T739 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368670455907
[junit4:junit4] 2> 250386 T739 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368670455907/solr.xml
[junit4:junit4] 2> 250386 T739 oasc.CoreContainer.<init> New CoreContainer 81147108
[junit4:junit4] 2> 250387 T739 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368670455907/'
[junit4:junit4] 2> 250387 T739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368670455907/'
[junit4:junit4] 2> 250466 T739 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 250467 T739 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 250467 T739 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 250467 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 250468 T739 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 250468 T739 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 250469 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 250469 T739 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 250469 T739 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 250470 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 250480 T739 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 250481 T739 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:12704/solr
[junit4:junit4] 2> 250481 T739 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 250482 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 250485 T795 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5cc6e70a name:ZooKeeperConnection Watcher:127.0.0.1:12704 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 250485 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 250499 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 250507 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 250509 T797 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17b7a32c name:ZooKeeperConnection Watcher:127.0.0.1:12704/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 250509 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 250521 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 251525 T739 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:12722__
[junit4:junit4] 2> 251553 T739 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:12722__
[junit4:junit4] 2> 251557 T761 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 251557 T781 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 251557 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 251557 T797 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 251557 T768 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 251557 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 251558 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 251575 T798 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368670455907/collection1
[junit4:junit4] 2> 251575 T798 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 251576 T798 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 251576 T798 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 251577 T798 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368670455907/collection1/'
[junit4:junit4] 2> 251578 T798 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1368670455907/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 251579 T798 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1368670455907/collection1/lib/README' to classloader
[junit4:junit4] 2> 251614 T798 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 251655 T798 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 251714 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 251714 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:12718___collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12718__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12718/_"}
[junit4:junit4] 2> 251742 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 251742 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 251742 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 251757 T798 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 251757 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 251762 T798 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 252232 T798 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252236 T798 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252239 T798 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252244 T798 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252276 T798 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252276 T798 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368670455907/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty2/
[junit4:junit4] 2> 252277 T798 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6222053a
[junit4:junit4] 2> 252277 T798 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252278 T798 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty2
[junit4:junit4] 2> 252278 T798 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty2/index/
[junit4:junit4] 2> 252279 T798 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 252280 T798 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty2/index
[junit4:junit4] 2> 252283 T798 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@72fba2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@6593816a),segFN=segments_1,generation=1}
[junit4:junit4] 2> 252283 T798 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 252287 T798 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 252287 T798 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 252288 T798 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 252289 T798 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 252289 T798 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 252290 T798 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 252290 T798 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 252291 T798 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 252291 T798 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 252304 T798 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 252311 T798 oass.SolrIndexSearcher.<init> Opening Searcher@364d771f main
[junit4:junit4] 2> 252311 T798 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty2/tlog
[junit4:junit4] 2> 252312 T798 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 252313 T798 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 252318 T799 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@364d771f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 252322 T798 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 252322 T798 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 253247 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 253248 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12722__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12722/_"}
[junit4:junit4] 2> 253249 T762 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 253249 T762 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 253265 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 253265 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 253265 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 253266 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 253325 T798 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 253325 T798 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:12722/_ collection:collection1 shard:shard2
[junit4:junit4] 2> 253326 T798 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 253343 T798 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 253355 T798 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 253355 T798 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 253355 T798 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:12722/_/collection1/
[junit4:junit4] 2> 253356 T798 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 253356 T798 oasc.SyncStrategy.syncToMe http://127.0.0.1:12722/_/collection1/ has no replicas
[junit4:junit4] 2> 253356 T798 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:12722/_/collection1/
[junit4:junit4] 2> 253357 T798 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 254771 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 254823 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 254823 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 254823 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 254823 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 254851 T798 oasc.ZkController.register We are http://127.0.0.1:12722/_/collection1/ and leader is http://127.0.0.1:12722/_/collection1/
[junit4:junit4] 2> 254851 T798 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:12722/_
[junit4:junit4] 2> 254851 T798 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 254851 T798 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 254852 T798 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 254854 T798 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 254855 T739 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 254856 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 254856 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 255244 T739 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 255248 T739 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:12725
[junit4:junit4] 2> 255250 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 255251 T739 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 255251 T739 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368670460550
[junit4:junit4] 2> 255252 T739 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368670460550/solr.xml
[junit4:junit4] 2> 255253 T739 oasc.CoreContainer.<init> New CoreContainer 453275569
[junit4:junit4] 2> 255254 T739 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368670460550/'
[junit4:junit4] 2> 255255 T739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368670460550/'
[junit4:junit4] 2> 255388 T739 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 255389 T739 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 255389 T739 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 255390 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 255390 T739 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 255391 T739 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 255391 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 255392 T739 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 255392 T739 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 255393 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 255411 T739 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 255411 T739 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:12704/solr
[junit4:junit4] 2> 255412 T739 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 255413 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 255419 T811 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2db266bf name:ZooKeeperConnection Watcher:127.0.0.1:12704 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 255419 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 255422 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 255436 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 255439 T813 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3dec5e1 name:ZooKeeperConnection Watcher:127.0.0.1:12704/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 255439 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 255451 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 256337 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 256338 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:12722___collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12722__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12722/_"}
[junit4:junit4] 2> 256371 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 256371 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 256371 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 256371 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 256371 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 256456 T739 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:12725__
[junit4:junit4] 2> 256458 T739 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:12725__
[junit4:junit4] 2> 256462 T781 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 256462 T761 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 256463 T768 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 256462 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 256462 T797 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 256462 T813 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 256463 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 256463 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 256463 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 256464 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 256476 T814 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368670460550/collection1
[junit4:junit4] 2> 256476 T814 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 256477 T814 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 256477 T814 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 256479 T814 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368670460550/collection1/'
[junit4:junit4] 2> 256480 T814 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1368670460550/collection1/lib/README' to classloader
[junit4:junit4] 2> 256481 T814 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1368670460550/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 256532 T814 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 256593 T814 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 256695 T814 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 256702 T814 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 257303 T814 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 257307 T814 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 257309 T814 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 257315 T814 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 257347 T814 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 257347 T814 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368670460550/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3/
[junit4:junit4] 2> 257347 T814 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6222053a
[junit4:junit4] 2> 257348 T814 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 257349 T814 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3
[junit4:junit4] 2> 257349 T814 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3/index/
[junit4:junit4] 2> 257349 T814 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 257350 T814 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3/index
[junit4:junit4] 2> 257354 T814 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2ef8dc2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2df94433),segFN=segments_1,generation=1}
[junit4:junit4] 2> 257354 T814 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 257357 T814 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 257358 T814 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 257358 T814 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 257359 T814 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 257360 T814 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 257360 T814 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 257361 T814 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 257361 T814 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 257362 T814 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 257375 T814 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 257381 T814 oass.SolrIndexSearcher.<init> Opening Searcher@7da76b2b main
[junit4:junit4] 2> 257382 T814 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3/tlog
[junit4:junit4] 2> 257383 T814 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 257383 T814 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 257389 T815 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7da76b2b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 257392 T814 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 257392 T814 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 257878 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 257880 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12725__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12725/_"}
[junit4:junit4] 2> 257880 T762 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 257880 T762 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 257886 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 257887 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 257887 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 257887 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 257887 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 258395 T814 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 258395 T814 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:12725/_ collection:collection1 shard:shard1
[junit4:junit4] 2> 258400 T814 oasc.ZkController.register We are http://127.0.0.1:12725/_/collection1/ and leader is http://127.0.0.1:12718/_/collection1/
[junit4:junit4] 2> 258400 T814 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:12725/_
[junit4:junit4] 2> 258400 T814 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 258400 T814 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C27 name=collection1 org.apache.solr.core.SolrCore@50106ad2 url=http://127.0.0.1:12725/_/collection1 node=127.0.0.1:12725__ C27_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:12725__, base_url=http://127.0.0.1:12725/_}
[junit4:junit4] 2> 258408 T816 C27 P12725 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 258409 T814 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 258409 T816 C27 P12725 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 258410 T816 C27 P12725 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 258410 T816 C27 P12725 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 258411 T739 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 258411 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 258412 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 258412 T816 C27 P12725 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 258456 T771 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:12725___collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 259305 T739 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 259309 T739 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:12729
[junit4:junit4] 2> 259310 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 259310 T739 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 259311 T739 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368670464104
[junit4:junit4] 2> 259311 T739 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368670464104/solr.xml
[junit4:junit4] 2> 259312 T739 oasc.CoreContainer.<init> New CoreContainer 216402566
[junit4:junit4] 2> 259312 T739 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368670464104/'
[junit4:junit4] 2> 259313 T739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368670464104/'
[junit4:junit4] 2> 259393 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 259394 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:12725___collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12725__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12725/_"}
[junit4:junit4] 2> 259432 T739 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 259433 T739 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 259434 T739 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 259434 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 259435 T739 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 259435 T739 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 259436 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 259436 T739 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 259437 T739 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 259437 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 259453 T739 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 259454 T739 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:12704/solr
[junit4:junit4] 2> 259455 T739 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 259456 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 259471 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 259471 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 259471 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 259471 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 259471 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 259473 T828 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ac54d8a name:ZooKeeperConnection Watcher:127.0.0.1:12704 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 259473 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 259528 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 259538 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 259540 T830 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3880c4d3 name:ZooKeeperConnection Watcher:127.0.0.1:12704/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 259540 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 259586 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 260459 T771 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:12725___collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 260460 T771 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:12725___collection1&state=recovering&nodeName=127.0.0.1:12725__&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2010
[junit4:junit4] 2> 260591 T739 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:12729__
[junit4:junit4] 2> 260593 T739 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:12729__
[junit4:junit4] 2> 260598 T768 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 260599 T781 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 260599 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 260599 T830 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 260599 T813 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 260598 T761 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 260600 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 260599 T797 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 260599 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 260601 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 260600 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 260609 T831 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368670464104/collection1
[junit4:junit4] 2> 260609 T831 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 260610 T831 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 260610 T831 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 260612 T831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368670464104/collection1/'
[junit4:junit4] 2> 260614 T831 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1368670464104/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 260614 T831 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1368670464104/collection1/lib/README' to classloader
[junit4:junit4] 2> 260682 T831 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 260745 T831 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 260847 T831 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 260854 T831 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 261448 T831 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 261452 T831 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 261455 T831 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 261461 T831 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 261491 T831 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 261491 T831 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368670464104/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/
[junit4:junit4] 2> 261491 T831 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6222053a
[junit4:junit4] 2> 261492 T831 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 261493 T831 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4
[junit4:junit4] 2> 261493 T831 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index/
[junit4:junit4] 2> 261493 T831 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 261494 T831 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index
[junit4:junit4] 2> 261497 T831 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73bbf8cc lockFactory=org.apache.lucene.store.NativeFSLockFactory@16c6028c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 261498 T831 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 261501 T831 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 261502 T831 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 261502 T831 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 261503 T831 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 261504 T831 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 261504 T831 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 261505 T831 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 261505 T831 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 261506 T831 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 261519 T831 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 261525 T831 oass.SolrIndexSearcher.<init> Opening Searcher@7c843551 main
[junit4:junit4] 2> 261525 T831 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/tlog
[junit4:junit4] 2> 261526 T831 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 261527 T831 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 261532 T832 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7c843551 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 261535 T831 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 261535 T831 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> C27_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:12725__, base_url=http://127.0.0.1:12725/_}
[junit4:junit4] 2> 262462 T816 C27 P12725 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:12718/_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 262472 T816 C27 P12725 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 262496 T816 C27 P12725 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:12725/_ START replicas=[http://127.0.0.1:12718/_/collection1/] nUpdates=100
[junit4:junit4] 2> 262508 T816 C27 P12725 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 262508 T816 C27 P12725 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 262509 T816 C27 P12725 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 262509 T816 C27 P12725 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 262509 T816 C27 P12725 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 262509 T816 C27 P12725 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:12718/_/collection1/. core=collection1
[junit4:junit4] 2> 262510 T816 C27 P12725 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C28 name=collection1 org.apache.solr.core.SolrCore@39e6d2b3 url=http://127.0.0.1:12718/_/collection1 node=127.0.0.1:12718__ C28_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:12718__, base_url=http://127.0.0.1:12718/_, leader=true}
[junit4:junit4] 2> 262523 T772 C28 P12718 oasc.SolrCore.execute [collection1] webapp=/_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 262525 T773 C28 P12718 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 262527 T773 C28 P12718 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@35d9668a lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b82f569),segFN=segments_1,generation=1}
[junit4:junit4] 2> 262528 T773 C28 P12718 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 262529 T773 C28 P12718 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@35d9668a lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b82f569),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@35d9668a lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b82f569),segFN=segments_2,generation=2}
[junit4:junit4] 2> 262529 T773 C28 P12718 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 262530 T773 C28 P12718 oass.SolrIndexSearcher.<init> Opening Searcher@61ed10f7 realtime
[junit4:junit4] 2> 262530 T773 C28 P12718 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 262531 T773 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 262534 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 262535 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12729__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12729/_"}
[junit4:junit4] 2> 262536 T762 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 262536 T762 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 262555 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 262555 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 262555 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 262555 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 262555 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 262555 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 262597 T816 C27 P12725 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 262598 T816 C27 P12725 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 262622 T816 C27 P12725 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 262625 T774 C28 P12718 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 262626 T774 C28 P12718 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 262627 T816 C27 P12725 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 262628 T816 C27 P12725 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 262628 T816 C27 P12725 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 262631 T774 C28 P12718 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 262632 T816 C27 P12725 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 262634 T816 C27 P12725 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3/index.20130516041428306
[junit4:junit4] 2> 262634 T816 C27 P12725 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3c7cb0fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e73a64c) fullCopy=false
[junit4:junit4] 2> 262648 T774 C28 P12718 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=5
[junit4:junit4] 2> 262661 T816 C27 P12725 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 262663 T816 C27 P12725 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 262663 T816 C27 P12725 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 262671 T816 C27 P12725 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2ef8dc2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2df94433),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2ef8dc2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2df94433),segFN=segments_2,generation=2}
[junit4:junit4] 2> 262672 T816 C27 P12725 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 262672 T816 C27 P12725 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 262672 T816 C27 P12725 oass.SolrIndexSearcher.<init> Opening Searcher@29acb39d main
[junit4:junit4] 2> 262674 T815 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@29acb39d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 262674 T816 C27 P12725 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3/index.20130516041428306 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3/index.20130516041428306;done=true>>]
[junit4:junit4] 2> 262675 T816 C27 P12725 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3/index.20130516041428306
[junit4:junit4] 2> 262675 T816 C27 P12725 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty3/index.20130516041428306
[junit4:junit4] 2> 262675 T816 C27 P12725 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 262675 T816 C27 P12725 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 262676 T816 C27 P12725 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 262676 T816 C27 P12725 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 262678 T816 C27 P12725 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 263539 T831 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 263539 T831 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:12729/_ collection:collection1 shard:shard2
[junit4:junit4] 2> 263544 T831 oasc.ZkController.register We are http://127.0.0.1:12729/_/collection1/ and leader is http://127.0.0.1:12722/_/collection1/
[junit4:junit4] 2> 263544 T831 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:12729/_
[junit4:junit4] 2> 263544 T831 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 263544 T831 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C29 name=collection1 org.apache.solr.core.SolrCore@68ee743a url=http://127.0.0.1:12729/_/collection1 node=127.0.0.1:12729__ C29_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:12729__, base_url=http://127.0.0.1:12729/_}
[junit4:junit4] 2> 263545 T835 C29 P12729 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 263546 T835 C29 P12729 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 263546 T831 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 263546 T835 C29 P12729 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 263547 T835 C29 P12729 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 263548 T739 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 263548 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 263549 T835 C29 P12729 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 263549 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 263566 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 263567 T787 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:12729___collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 263569 T739 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 263569 T739 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 263570 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 264062 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 264064 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:12725___collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12725__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12725/_"}
[junit4:junit4] 2> 264088 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:12729___collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12729__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12729/_"}
[junit4:junit4] 2> 264116 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264117 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264117 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264117 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264116 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264116 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264569 T787 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:12729___collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 264569 T787 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:12729___collection1&state=recovering&nodeName=127.0.0.1:12729__&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 264574 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 265578 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C29_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:12729__, base_url=http://127.0.0.1:12729/_}
[junit4:junit4] 2> 266571 T835 C29 P12729 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:12722/_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 266571 T835 C29 P12729 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:12729/_ START replicas=[http://127.0.0.1:12722/_/collection1/] nUpdates=100
[junit4:junit4] 2> 266573 T835 C29 P12729 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 266573 T835 C29 P12729 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 266573 T835 C29 P12729 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 266573 T835 C29 P12729 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 266573 T835 C29 P12729 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 266574 T835 C29 P12729 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:12722/_/collection1/. core=collection1
[junit4:junit4] 2> 266574 T835 C29 P12729 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 266580 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C30 name=collection1 org.apache.solr.core.SolrCore@1721a92c url=http://127.0.0.1:12722/_/collection1 node=127.0.0.1:12722__ C30_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:12722__, base_url=http://127.0.0.1:12722/_, leader=true}
[junit4:junit4] 2> 266582 T788 C30 P12722 oasc.SolrCore.execute [collection1] webapp=/_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 266592 T789 C30 P12722 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 266595 T789 C30 P12722 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@72fba2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@6593816a),segFN=segments_1,generation=1}
[junit4:junit4] 2> 266595 T789 C30 P12722 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 266596 T789 C30 P12722 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@72fba2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@6593816a),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@72fba2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@6593816a),segFN=segments_2,generation=2}
[junit4:junit4] 2> 266596 T789 C30 P12722 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 266597 T789 C30 P12722 oass.SolrIndexSearcher.<init> Opening Searcher@67b7b79b realtime
[junit4:junit4] 2> 266598 T789 C30 P12722 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 266598 T789 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 266599 T835 C29 P12729 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 266600 T835 C29 P12729 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 266602 T790 C30 P12722 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 266602 T790 C30 P12722 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 266603 T835 C29 P12729 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 266604 T835 C29 P12729 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 266604 T835 C29 P12729 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 266607 T790 C30 P12722 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 266608 T835 C29 P12729 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 266609 T835 C29 P12729 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index.20130516041432281
[junit4:junit4] 2> 266609 T835 C29 P12729 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@5adfdd53 lockFactory=org.apache.lucene.store.NativeFSLockFactory@b75ac1f) fullCopy=false
[junit4:junit4] 2> 266612 T790 C30 P12722 oasc.SolrCore.execute [collection1] webapp=/_ path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 266613 T835 C29 P12729 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 266614 T835 C29 P12729 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 266614 T835 C29 P12729 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 266616 T835 C29 P12729 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73bbf8cc lockFactory=org.apache.lucene.store.NativeFSLockFactory@16c6028c),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73bbf8cc lockFactory=org.apache.lucene.store.NativeFSLockFactory@16c6028c),segFN=segments_2,generation=2}
[junit4:junit4] 2> 266617 T835 C29 P12729 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 266617 T835 C29 P12729 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 266617 T835 C29 P12729 oass.SolrIndexSearcher.<init> Opening Searcher@3e76dc70 main
[junit4:junit4] 2> 266619 T832 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e76dc70 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 266619 T835 C29 P12729 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index.20130516041432281 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index.20130516041432281;done=true>>]
[junit4:junit4] 2> 266619 T835 C29 P12729 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index.20130516041432281
[junit4:junit4] 2> 266620 T835 C29 P12729 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index.20130516041432281
[junit4:junit4] 2> 266620 T835 C29 P12729 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 266620 T835 C29 P12729 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 266620 T835 C29 P12729 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 266621 T835 C29 P12729 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 266623 T835 C29 P12729 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 267159 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 267160 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:12729___collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12729__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12729/_"}
[junit4:junit4] 2> 267173 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267174 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267174 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267174 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267173 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267173 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267583 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 267585 T739 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C31 name=collection1 org.apache.solr.core.SolrCore@3f8933d5 url=http://127.0.0.1:12707/_/collection1 node=127.0.0.1:12707__ C31_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:12707__, base_url=http://127.0.0.1:12707/_, leader=true}
[junit4:junit4] 2> 267592 T751 C31 P12707 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 267594 T751 C31 P12707 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a3b4ac6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dc49080),segFN=segments_1,generation=1}
[junit4:junit4] 2> 267595 T751 C31 P12707 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 267596 T751 C31 P12707 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a3b4ac6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dc49080),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a3b4ac6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dc49080),segFN=segments_2,generation=2}
[junit4:junit4] 2> 267596 T751 C31 P12707 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 267596 T751 C31 P12707 oass.SolrIndexSearcher.<init> Opening Searcher@14eb415b main
[junit4:junit4] 2> 267597 T751 C31 P12707 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 267597 T765 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14eb415b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 267598 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 267616 T791 C30 P12722 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 267617 T791 C30 P12722 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@72fba2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@6593816a),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@72fba2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@6593816a),segFN=segments_3,generation=3}
[junit4:junit4] 2> 267618 T791 C30 P12722 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 267618 T791 C30 P12722 oass.SolrIndexSearcher.<init> Opening Searcher@3e5fa2ad main
[junit4:junit4] 2> 267619 T791 C30 P12722 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 267619 T799 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e5fa2ad main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 267620 T791 C30 P12722 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:12718/_/collection1/, StdNode: http://127.0.0.1:12725/_/collection1/, StdNode: http://127.0.0.1:12729/_/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 267623 T775 C28 P12718 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 267624 T775 C28 P12718 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@35d9668a lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b82f569),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@35d9668a lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b82f569),segFN=segments_3,generation=3}
[junit4:junit4] 2> 267624 T775 C28 P12718 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 267625 T775 C28 P12718 oass.SolrIndexSearcher.<init> Opening Searcher@2d7a842c main
[junit4:junit4] 2> 267625 T775 C28 P12718 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 267626 T783 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d7a842c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 267626 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 2> C29_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:12729__, base_url=http://127.0.0.1:12729/_}
[junit4:junit4] 2> 267629 T820 C29 P12729 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 267630 T820 C29 P12729 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73bbf8cc lockFactory=org.apache.lucene.store.NativeFSLockFactory@16c6028c),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73bbf8cc lockFactory=org.apache.lucene.store.NativeFSLockFactory@16c6028c),segFN=segments_3,generation=3}
[junit4:junit4] 2> 267630 T820 C29 P12729 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 267631 T820 C29 P12729 oass.SolrIndexSearcher.<init> Opening Searcher@5e11e71f main
[junit4:junit4] 2> 267631 T820 C29 P12729 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> C27_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:12725__, base_url=http://127.0.0.1:12725/_}
[junit4:junit4] 2> 267632 T803 C27 P12725 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 267633 T832 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5e11e71f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 267633 T803 C27 P12725 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2ef8dc2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2df94433),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2ef8dc2f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2df94433),segFN=segments_3,generation=3}
[junit4:junit4] 2> 267634 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 267634 T803 C27 P12725 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 267635 T803 C27 P12725 oass.SolrIndexSearcher.<init> Opening Searcher@f5620ab main
[junit4:junit4] 2> 267635 T803 C27 P12725 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 267636 T815 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f5620ab main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 267637 T803 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 267637 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 267639 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 267642 T776 C28 P12718 oasc.SolrCore.execute [collection1] webapp=/_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 267645 T804 C27 P12725 oasc.SolrCore.execute [collection1] webapp=/_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 267648 T792 C30 P12722 oasc.SolrCore.execute [collection1] webapp=/_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 267651 T821 C29 P12729 oasc.SolrCore.execute [collection1] webapp=/_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 269657 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435155012338581504)} 0 1
[junit4:junit4] 2> 269665 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={update.distrib=FROMLEADER&_version_=-1435155012342775808&update.from=http://127.0.0.1:12718/_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435155012342775808)} 0 1
[junit4:junit4] 2> 269669 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={update.distrib=FROMLEADER&_version_=-1435155012346970112&update.from=http://127.0.0.1:12722/_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435155012346970112)} 0 1
[junit4:junit4] 2> 269670 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435155012346970112)} 0 6
[junit4:junit4] 2> 269671 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435155012342775808)} 0 12
[junit4:junit4] 2> 269675 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[a!0 (1435155012358504448)]} 0 1
[junit4:junit4] 2> 269684 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435155012362698752)]} 0 1
[junit4:junit4] 2> 269684 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[a!0 (1435155012362698752)]} 0 6
[junit4:junit4] 2> 269689 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[b!1 (1435155012372135936)]} 0 1
[junit4:junit4] 2> 269704 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435155012385767424)]} 0 1
[junit4:junit4] 2> 269705 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!1 (1435155012385767424)]} 0 5
[junit4:junit4] 2> 269705 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[b!1]} 0 13
[junit4:junit4] 2> 269709 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[c!2 (1435155012394156032)]} 0 1
[junit4:junit4] 2> 269716 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435155012398350336)]} 0 1
[junit4:junit4] 2> 269716 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[c!2 (1435155012398350336)]} 0 4
[junit4:junit4] 2> 269720 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[d!3 (1435155012404641792)]} 0 1
[junit4:junit4] 2> 269726 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435155012408836096)]} 0 1
[junit4:junit4] 2> 269727 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[d!3 (1435155012408836096)]} 0 5
[junit4:junit4] 2> 269731 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[e!4 (1435155012416176128)]} 0 1
[junit4:junit4] 2> 269740 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435155012422467584)]} 0 1
[junit4:junit4] 2> 269741 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1435155012422467584)]} 0 5
[junit4:junit4] 2> 269742 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[e!4]} 0 9
[junit4:junit4] 2> 269746 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[f!5 (1435155012431904768)]} 0 1
[junit4:junit4] 2> 269755 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435155012438196224)]} 0 0
[junit4:junit4] 2> 269756 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1435155012438196224)]} 0 5
[junit4:junit4] 2> 269757 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[f!5]} 0 9
[junit4:junit4] 2> 269774 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[g!6 (1435155012461264896)]} 0 1
[junit4:junit4] 2> 269784 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435155012468604928)]} 0 1
[junit4:junit4] 2> 269785 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1435155012468604928)]} 0 5
[junit4:junit4] 2> 269785 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[g!6]} 0 8
[junit4:junit4] 2> 269789 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[h!7 (1435155012478042112)]} 0 1
[junit4:junit4] 2> 269799 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435155012485382144)]} 0 1
[junit4:junit4] 2> 269800 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1435155012485382144)]} 0 5
[junit4:junit4] 2> 269800 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[h!7]} 0 8
[junit4:junit4] 2> 269804 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[i!8 (1435155012493770752)]} 0 1
[junit4:junit4] 2> 269811 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435155012497965056)]} 0 1
[junit4:junit4] 2> 269812 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[i!8 (1435155012497965056)]} 0 4
[junit4:junit4] 2> 269815 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[j!9 (1435155012504256512)]} 0 1
[junit4:junit4] 2> 269821 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435155012508450816)]} 0 0
[junit4:junit4] 2> 269822 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[j!9 (1435155012508450816)]} 0 5
[junit4:junit4] 2> 269826 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[k!10 (1435155012516839424)]} 0 1
[junit4:junit4] 2> 269833 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435155012519985152)]} 0 1
[junit4:junit4] 2> 269833 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[k!10 (1435155012519985152)]} 0 4
[junit4:junit4] 2> 269837 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[l!11 (1435155012527325184)]} 0 1
[junit4:junit4] 2> 269844 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435155012531519488)]} 0 1
[junit4:junit4] 2> 269845 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[l!11 (1435155012531519488)]} 0 5
[junit4:junit4] 2> 269849 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[m!12 (1435155012539908096)]} 0 1
[junit4:junit4] 2> 269858 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435155012547248128)]} 0 1
[junit4:junit4] 2> 269859 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1435155012547248128)]} 0 5
[junit4:junit4] 2> 269859 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[m!12]} 0 8
[junit4:junit4] 2> 269863 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[n!13 (1435155012554588160)]} 0 1
[junit4:junit4] 2> 269872 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435155012561928192)]} 0 1
[junit4:junit4] 2> 269873 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1435155012561928192)]} 0 4
[junit4:junit4] 2> 269873 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[n!13]} 0 8
[junit4:junit4] 2> 269876 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[o!14 (1435155012569268224)]} 0 0
[junit4:junit4] 2> 269883 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435155012572413952)]} 0 0
[junit4:junit4] 2> 269884 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[o!14 (1435155012572413952)]} 0 5
[junit4:junit4] 2> 269887 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[p!15 (1435155012580802560)]} 0 0
[junit4:junit4] 2> 269897 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435155012587094016)]} 0 1
[junit4:junit4] 2> 269897 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!15 (1435155012587094016)]} 0 4
[junit4:junit4] 2> 269898 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[p!15]} 0 8
[junit4:junit4] 2> 269901 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[q!16 (1435155012595482624)]} 0 0
[junit4:junit4] 2> 269908 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435155012598628352)]} 0 1
[junit4:junit4] 2> 269908 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[q!16 (1435155012598628352)]} 0 4
[junit4:junit4] 2> 269911 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[r!17 (1435155012605968384)]} 0 0
[junit4:junit4] 2> 269920 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435155012612259840)]} 0 1
[junit4:junit4] 2> 269921 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!17 (1435155012612259840)]} 0 5
[junit4:junit4] 2> 269921 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[r!17]} 0 7
[junit4:junit4] 2> 269924 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[s!18 (1435155012619599872)]} 0 0
[junit4:junit4] 2> 269931 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435155012622745600)]} 0 1
[junit4:junit4] 2> 269931 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[s!18 (1435155012622745600)]} 0 4
[junit4:junit4] 2> 269934 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[t!19 (1435155012630085632)]} 0 0
[junit4:junit4] 2> 269945 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435155012636377088)]} 0 1
[junit4:junit4] 2> 269946 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!19 (1435155012636377088)]} 0 6
[junit4:junit4] 2> 269947 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[t!19]} 0 10
[junit4:junit4] 2> 269951 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[u!20 (1435155012647911424)]} 0 1
[junit4:junit4] 2> 269958 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435155012652105728)]} 0 1
[junit4:junit4] 2> 269959 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[u!20 (1435155012652105728)]} 0 5
[junit4:junit4] 2> 269962 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[v!21 (1435155012658397184)]} 0 1
[junit4:junit4] 2> 269972 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435155012665737216)]} 0 1
[junit4:junit4] 2> 269973 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!21 (1435155012665737216)]} 0 5
[junit4:junit4] 2> 269973 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[v!21]} 0 8
[junit4:junit4] 2> 269977 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[w!22 (1435155012675174400)]} 0 1
[junit4:junit4] 2> 269987 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435155012682514432)]} 0 1
[junit4:junit4] 2> 269987 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!22 (1435155012682514432)]} 0 4
[junit4:junit4] 2> 269988 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[w!22]} 0 8
[junit4:junit4] 2> 269992 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[x!23 (1435155012689854464)]} 0 1
[junit4:junit4] 2> 269997 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435155012691951616)]} 0 1
[junit4:junit4] 2> 269998 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[x!23 (1435155012691951616)]} 0 5
[junit4:junit4] 2> 270001 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[y!24 (1435155012699291648)]} 0 1
[junit4:junit4] 2> 270010 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435155012706631680)]} 0 1
[junit4:junit4] 2> 270011 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1435155012706631680)]} 0 5
[junit4:junit4] 2> 270011 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[y!24]} 0 8
[junit4:junit4] 2> 270015 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[z!25 (1435155012713971712)]} 0 1
[junit4:junit4] 2> 270024 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435155012720263168)]} 0 1
[junit4:junit4] 2> 270025 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1435155012720263168)]} 0 5
[junit4:junit4] 2> 270025 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[z!25]} 0 8
[junit4:junit4] 2> 270029 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[a!26 (1435155012728651776)]} 0 1
[junit4:junit4] 2> 270035 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435155012732846080)]} 0 1
[junit4:junit4] 2> 270036 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[a!26 (1435155012732846080)]} 0 5
[junit4:junit4] 2> 270039 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[b!27 (1435155012740186112)]} 0 0
[junit4:junit4] 2> 270049 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435155012746477568)]} 0 1
[junit4:junit4] 2> 270050 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1435155012746477568)]} 0 5
[junit4:junit4] 2> 270051 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[b!27]} 0 9
[junit4:junit4] 2> 270053 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[c!28 (1435155012754866176)]} 0 0
[junit4:junit4] 2> 270060 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435155012759060480)]} 0 1
[junit4:junit4] 2> 270061 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[c!28 (1435155012759060480)]} 0 5
[junit4:junit4] 2> 270065 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[d!29 (1435155012766400512)]} 0 1
[junit4:junit4] 2> 270071 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435155012770594816)]} 0 0
[junit4:junit4] 2> 270072 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[d!29 (1435155012770594816)]} 0 5
[junit4:junit4] 2> 270076 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[e!30 (1435155012777934848)]} 0 1
[junit4:junit4] 2> 270087 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435155012786323456)]} 0 1
[junit4:junit4] 2> 270088 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!30 (1435155012786323456)]} 0 5
[junit4:junit4] 2> 270089 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[e!30]} 0 10
[junit4:junit4] 2> 270093 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[f!31 (1435155012796809216)]} 0 1
[junit4:junit4] 2> 270103 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435155012804149248)]} 0 1
[junit4:junit4] 2> 270104 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1435155012804149248)]} 0 4
[junit4:junit4] 2> 270104 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[f!31]} 0 8
[junit4:junit4] 2> 270108 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[g!32 (1435155012812537856)]} 0 1
[junit4:junit4] 2> 270115 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435155012815683584)]} 0 1
[junit4:junit4] 2> 270116 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[g!32 (1435155012815683584)]} 0 5
[junit4:junit4] 2> 270119 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[h!33 (1435155012823023616)]} 0 1
[junit4:junit4] 2> 270125 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435155012826169344)]} 0 1
[junit4:junit4] 2> 270126 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[h!33 (1435155012826169344)]} 0 5
[junit4:junit4] 2> 270130 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[i!34 (1435155012835606528)]} 0 1
[junit4:junit4] 2> 270137 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435155012839800832)]} 0 1
[junit4:junit4] 2> 270138 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[i!34 (1435155012839800832)]} 0 4
[junit4:junit4] 2> 270142 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[j!35 (1435155012847140864)]} 0 1
[junit4:junit4] 2> 270152 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435155012855529472)]} 0 1
[junit4:junit4] 2> 270153 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!35 (1435155012855529472)]} 0 5
[junit4:junit4] 2> 270153 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[j!35]} 0 8
[junit4:junit4] 2> 270157 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[k!36 (1435155012862869504)]} 0 1
[junit4:junit4] 2> 270167 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1435155012870209536)]} 0 1
[junit4:junit4] 2> 270168 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1435155012870209536)]} 0 5
[junit4:junit4] 2> 270168 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[k!36]} 0 8
[junit4:junit4] 2> 270172 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[l!37 (1435155012879646720)]} 0 1
[junit4:junit4] 2> 270182 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1435155012885938176)]} 0 1
[junit4:junit4] 2> 270183 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1435155012885938176)]} 0 5
[junit4:junit4] 2> 270183 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[l!37]} 0 8
[junit4:junit4] 2> 270187 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[m!38 (1435155012895375360)]} 0 1
[junit4:junit4] 2> 270197 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1435155012901666816)]} 0 1
[junit4:junit4] 2> 270197 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!38 (1435155012901666816)]} 0 4
[junit4:junit4] 2> 270198 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[m!38]} 0 8
[junit4:junit4] 2> 270202 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[n!39 (1435155012911104000)]} 0 1
[junit4:junit4] 2> 270212 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1435155012918444032)]} 0 0
[junit4:junit4] 2> 270213 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1435155012918444032)]} 0 5
[junit4:junit4] 2> 270214 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[n!39]} 0 9
[junit4:junit4] 2> 270218 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[o!40 (1435155012927881216)]} 0 1
[junit4:junit4] 2> 270228 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1435155012935221248)]} 0 1
[junit4:junit4] 2> 270229 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1435155012935221248)]} 0 5
[junit4:junit4] 2> 270229 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[o!40]} 0 8
[junit4:junit4] 2> 270233 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[p!41 (1435155012942561280)]} 0 1
[junit4:junit4] 2> 270240 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1435155012946755584)]} 0 1
[junit4:junit4] 2> 270241 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[p!41 (1435155012946755584)]} 0 4
[junit4:junit4] 2> 270244 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[q!42 (1435155012954095616)]} 0 1
[junit4:junit4] 2> 270253 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1435155012960387072)]} 0 1
[junit4:junit4] 2> 270253 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!42 (1435155012960387072)]} 0 4
[junit4:junit4] 2> 270254 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[q!42]} 0 8
[junit4:junit4] 2> 270258 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[r!43 (1435155012968775680)]} 0 1
[junit4:junit4] 2> 270267 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1435155012976115712)]} 0 1
[junit4:junit4] 2> 270268 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!43 (1435155012976115712)]} 0 5
[junit4:junit4] 2> 270268 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[r!43]} 0 8
[junit4:junit4] 2> 270272 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[s!44 (1435155012983455744)]} 0 1
[junit4:junit4] 2> 270278 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1435155012987650048)]} 0 1
[junit4:junit4] 2> 270278 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[s!44 (1435155012987650048)]} 0 4
[junit4:junit4] 2> 270282 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[t!45 (1435155012993941504)]} 0 1
[junit4:junit4] 2> 270288 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1435155012998135808)]} 0 1
[junit4:junit4] 2> 270288 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[t!45 (1435155012998135808)]} 0 4
[junit4:junit4] 2> 270291 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[u!46 (1435155013004427264)]} 0 0
[junit4:junit4] 2> 270297 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1435155013008621568)]} 0 0
[junit4:junit4] 2> 270298 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[u!46 (1435155013008621568)]} 0 4
[junit4:junit4] 2> 270302 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[v!47 (1435155013014913024)]} 0 1
[junit4:junit4] 2> 270307 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1435155013018058752)]} 0 0
[junit4:junit4] 2> 270308 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[v!47 (1435155013018058752)]} 0 4
[junit4:junit4] 2> 270312 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[w!48 (1435155013025398784)]} 0 0
[junit4:junit4] 2> 270318 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1435155013028544512)]} 0 1
[junit4:junit4] 2> 270318 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[w!48 (1435155013028544512)]} 0 4
[junit4:junit4] 2> 270321 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[x!49 (1435155013035884544)]} 0 0
[junit4:junit4] 2> 270328 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1435155013039030272)]} 0 1
[junit4:junit4] 2> 270328 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[x!49 (1435155013039030272)]} 0 4
[junit4:junit4] 2> 270331 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[y!50 (1435155013046370304)]} 0 0
[junit4:junit4] 2> 270337 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1435155013049516032)]} 0 0
[junit4:junit4] 2> 270338 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[y!50 (1435155013049516032)]} 0 4
[junit4:junit4] 2> 270341 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[z!51 (1435155013056856064)]} 0 0
[junit4:junit4] 2> 270351 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1435155013063147520)]} 0 1
[junit4:junit4] 2> 270351 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!51 (1435155013063147520)]} 0 4
[junit4:junit4] 2> 270352 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[z!51]} 0 8
[junit4:junit4] 2> 270356 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[a!52 (1435155013071536128)]} 0 1
[junit4:junit4] 2> 270365 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1435155013077827584)]} 0 1
[junit4:junit4] 2> 270365 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!52 (1435155013077827584)]} 0 4
[junit4:junit4] 2> 270366 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[a!52]} 0 8
[junit4:junit4] 2> 270370 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[b!53 (1435155013087264768)]} 0 1
[junit4:junit4] 2> 270380 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1435155013093556224)]} 0 1
[junit4:junit4] 2> 270381 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1435155013093556224)]} 0 5
[junit4:junit4] 2> 270381 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[b!53]} 0 8
[junit4:junit4] 2> 270385 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[c!54 (1435155013101944832)]} 0 1
[junit4:junit4] 2> 270395 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1435155013109284864)]} 0 1
[junit4:junit4] 2> 270396 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!54 (1435155013109284864)]} 0 5
[junit4:junit4] 2> 270396 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[c!54]} 0 8
[junit4:junit4] 2> 270400 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[d!55 (1435155013117673472)]} 0 1
[junit4:junit4] 2> 270409 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1435155013123964928)]} 0 1
[junit4:junit4] 2> 270410 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1435155013123964928)]} 0 5
[junit4:junit4] 2> 270410 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[d!55]} 0 8
[junit4:junit4] 2> 270414 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[e!56 (1435155013132353536)]} 0 1
[junit4:junit4] 2> 270423 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1435155013139693568)]} 0 1
[junit4:junit4] 2> 270424 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1435155013139693568)]} 0 5
[junit4:junit4] 2> 270424 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[e!56]} 0 8
[junit4:junit4] 2> 270428 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[f!57 (1435155013147033600)]} 0 1
[junit4:junit4] 2> 270437 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1435155013153325056)]} 0 1
[junit4:junit4] 2> 270437 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1435155013153325056)]} 0 4
[junit4:junit4] 2> 270438 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[f!57]} 0 8
[junit4:junit4] 2> 270441 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[g!58 (1435155013161713664)]} 0 0
[junit4:junit4] 2> 270451 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1435155013168005120)]} 0 1
[junit4:junit4] 2> 270451 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1435155013168005120)]} 0 4
[junit4:junit4] 2> 270452 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[g!58]} 0 8
[junit4:junit4] 2> 270455 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[h!59 (1435155013176393728)]} 0 0
[junit4:junit4] 2> 270462 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1435155013179539456)]} 0 1
[junit4:junit4] 2> 270462 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[h!59 (1435155013179539456)]} 0 4
[junit4:junit4] 2> 270465 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[i!60 (1435155013186879488)]} 0 0
[junit4:junit4] 2> 270475 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1435155013193170944)]} 0 1
[junit4:junit4] 2> 270475 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1435155013193170944)]} 0 4
[junit4:junit4] 2> 270476 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[i!60]} 0 8
[junit4:junit4] 2> 270479 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[j!61 (1435155013201559552)]} 0 0
[junit4:junit4] 2> 270486 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1435155013204705280)]} 0 1
[junit4:junit4] 2> 270486 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[j!61 (1435155013204705280)]} 0 4
[junit4:junit4] 2> 270490 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[k!62 (1435155013212045312)]} 0 0
[junit4:junit4] 2> 270498 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1435155013218336768)]} 0 0
[junit4:junit4] 2> 270499 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!62 (1435155013218336768)]} 0 4
[junit4:junit4] 2> 270500 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[k!62]} 0 8
[junit4:junit4] 2> 270503 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[l!63 (1435155013226725376)]} 0 0
[junit4:junit4] 2> 270510 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1435155013229871104)]} 0 1
[junit4:junit4] 2> 270510 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[l!63 (1435155013229871104)]} 0 4
[junit4:junit4] 2> 270513 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[m!64 (1435155013237211136)]} 0 0
[junit4:junit4] 2> 270523 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1435155013243502592)]} 0 1
[junit4:junit4] 2> 270523 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!64 (1435155013243502592)]} 0 4
[junit4:junit4] 2> 270524 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[m!64]} 0 8
[junit4:junit4] 2> 270527 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[n!65 (1435155013250842624)]} 0 1
[junit4:junit4] 2> 270536 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1435155013257134080)]} 0 1
[junit4:junit4] 2> 270536 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!65 (1435155013257134080)]} 0 4
[junit4:junit4] 2> 270537 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[n!65]} 0 8
[junit4:junit4] 2> 270540 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[o!66 (1435155013265522688)]} 0 0
[junit4:junit4] 2> 270547 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1435155013268668416)]} 0 0
[junit4:junit4] 2> 270547 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[o!66 (1435155013268668416)]} 0 4
[junit4:junit4] 2> 270550 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[p!67 (1435155013276008448)]} 0 0
[junit4:junit4] 2> 270559 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1435155013281251328)]} 0 1
[junit4:junit4] 2> 270559 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!67 (1435155013281251328)]} 0 4
[junit4:junit4] 2> 270560 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[p!67]} 0 7
[junit4:junit4] 2> 270564 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[q!68 (1435155013290688512)]} 0 1
[junit4:junit4] 2> 270571 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1435155013293834240)]} 0 1
[junit4:junit4] 2> 270571 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[q!68 (1435155013293834240)]} 0 4
[junit4:junit4] 2> 270575 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[r!69 (1435155013301174272)]} 0 1
[junit4:junit4] 2> 270584 T820 C29 P12729 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!69 (1435155013307465728)]} 0 1
[junit4:junit4] 2> 270584 T793 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!69 (1435155013307465728)]} 0 4
[junit4:junit4] 2> 270585 T777 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[r!69]} 0 8
[junit4:junit4] 2> 270589 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[s!70 (1435155013316902912)]} 0 1
[junit4:junit4] 2> 270600 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!70 (1435155013324242944)]} 0 1
[junit4:junit4] 2> 270601 T775 C28 P12718 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12722/_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!70 (1435155013324242944)]} 0 6
[junit4:junit4] 2> 270602 T791 C30 P12722 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[s!70]} 0 10
[junit4:junit4] 2> 270607 T751 C31 P12707 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={wt=javabin&version=2} {add=[t!71 (1435155013335777280)]} 0 1
[junit4:junit4] 2> 270614 T805 C27 P12725 oasup.LogUpdateProcessor.finish [collection1] webapp=/_ path=/update params={distrib.from=http://127.0.0.1:12718/_/collection1/&up
[...truncated too long message...]
rStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:12725___collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12725__",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12725/_"}
[junit4:junit4] 2> 282449 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 282457 T739 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 12729
[junit4:junit4] 2> 282457 T739 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=216402566
[junit4:junit4] 2> 283460 T739 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 283460 T739 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 283463 T739 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@68ee743a
[junit4:junit4] 2> 283469 T739 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=14,adds=14,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=56,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 283470 T739 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 283470 T739 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 283471 T739 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> C29_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:12729__, base_url=http://127.0.0.1:12729/_, leader=true}
[junit4:junit4] 2> 283473 T739 C29 P12729 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73bbf8cc lockFactory=org.apache.lucene.store.NativeFSLockFactory@16c6028c),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73bbf8cc lockFactory=org.apache.lucene.store.NativeFSLockFactory@16c6028c),segFN=segments_5,generation=5}
[junit4:junit4] 2> 283473 T739 C29 P12729 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 283475 T739 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 283475 T739 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 283476 T739 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index;done=false>>]
[junit4:junit4] 2> 283476 T739 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4/index
[junit4:junit4] 2> 283476 T739 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4;done=false>>]
[junit4:junit4] 2> 283477 T739 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368670447386/jetty4
[junit4:junit4] 2> 283478 T861 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89697186440347660-127.0.0.1:12729__-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 283479 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 283479 T830 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 283480 T739 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/_,null}
[junit4:junit4] 2> 283480 T830 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 283545 T739 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 283547 T739 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:12704 12704
[junit4:junit4] 2> 283705 T813 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 283801 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 283802 T813 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 283803 T739 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 12707
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-1368670447386 FAILED !!!!!
[junit4:junit4] 2> 283804 T739 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 283804 T739 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:12704 12704
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=5313B44CCF98DE0A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_SD -Dtests.timezone=Europe/Belgrade -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 42.1s J1 | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:12718/_ returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([5313B44CCF98DE0A:D2F53A54B8C7BE36]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 283823 T739 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 42122 T738 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=Lucene41(blocksize=128), _version_=PostingsFormat(name=MockRandom)}, docValues:{}, sim=DefaultSimilarity, locale=ar_SD, timezone=Europe/Belgrade
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=1,free=95837088,total=196083712
[junit4:junit4] 2> NOTE: All tests run in this JVM: [StatelessScriptUpdateProcessorFactoryTest, SimplePostToolTest, TestCSVLoader, TestFastLRUCache, HardAutoCommitTest, IndexSchemaRuntimeFieldTest, TestPhraseSuggestions, TestZkChroot, TestLMJelinekMercerSimilarityFactory, UpdateRequestProcessorFactoryTest, FileBasedSpellCheckerTest, TestLuceneMatchVersion, BadComponentTest, LegacyHTMLStripCharFilterTest, TestDefaultSimilarityFactory, TestGroupingSearch, FieldAnalysisRequestHandlerTest, TermsComponentTest, TestSchemaNameResource, AutoCommitTest, PluginInfoTest, SOLR749Test, AnalysisAfterCoreReloadTest, TestWordDelimiterFilterFactory, SolrCmdDistributorTest, TestRemoteStreaming, SuggesterFSTTest, AlternateDirectoryTest, TestMultiCoreConfBootstrap, TestJmxIntegration, TestLFUCache, RegexBoostProcessorTest, TestRandomDVFaceting, QueryEqualityTest, LeaderElectionTest, OpenExchangeRatesOrgProviderTest, ShardSplitTest]
[junit4:junit4] Completed on J1 in 42.83s, 1 test, 1 error <<< FAILURES!
[...truncated 773 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 27 ignored (8 assumptions)
Total time: 48 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1250 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1250/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.update.processor.RegexBoostProcessorTest
Error Message:
Clean up static fields (in @AfterClass?), your test seems to hang on to approximately 24,564,080 bytes (threshold is 10,485,760). Field reference sizes (counted individually): - 25,128,200 bytes, protected static org.apache.solr.servlet.SolrRequestParsers org.apache.solr.update.processor.RegexBoostProcessorTest._parser - 5,192 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessorFactory org.apache.solr.update.processor.RegexBoostProcessorTest.factory - 4,520 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessor org.apache.solr.update.processor.RegexBoostProcessorTest.reProcessor - 816 bytes, protected static org.apache.solr.common.params.ModifiableSolrParams org.apache.solr.update.processor.RegexBoostProcessorTest.parameters - 280 bytes, public static org.junit.rules.TestRule org.apache.solr.SolrTestCaseJ4.solrClassRules - 248 bytes, protected static java.lang.String org.apache.solr.SolrTestCaseJ4.testSolrHome - 128 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.factoryProp - 64 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.coreName
Stack Trace:
junit.framework.AssertionFailedError: Clean up static fields (in @AfterClass?), your test seems to hang on to approximately 24,564,080 bytes (threshold is 10,485,760). Field reference sizes (counted individually):
- 25,128,200 bytes, protected static org.apache.solr.servlet.SolrRequestParsers org.apache.solr.update.processor.RegexBoostProcessorTest._parser
- 5,192 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessorFactory org.apache.solr.update.processor.RegexBoostProcessorTest.factory
- 4,520 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessor org.apache.solr.update.processor.RegexBoostProcessorTest.reProcessor
- 816 bytes, protected static org.apache.solr.common.params.ModifiableSolrParams org.apache.solr.update.processor.RegexBoostProcessorTest.parameters
- 280 bytes, public static org.junit.rules.TestRule org.apache.solr.SolrTestCaseJ4.solrClassRules
- 248 bytes, protected static java.lang.String org.apache.solr.SolrTestCaseJ4.testSolrHome
- 128 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.factoryProp
- 64 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.coreName
at __randomizedtesting.SeedInfo.seed([30F79478D1F21737]:0)
at com.carrotsearch.randomizedtesting.rules.StaticFieldsInvariantRule$1.afterAlways(StaticFieldsInvariantRule.java:127)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Wrong doc count on shard1_1 expected:<487> but was:<486>
Stack Trace:
java.lang.AssertionError: Wrong doc count on shard1_1 expected:<487> but was:<486>
at __randomizedtesting.SeedInfo.seed([30F79478D1F21737:B1111A60A6AD770B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.ShardSplitTest.checkDocCountsAndShardStates(ShardSplitTest.java:167)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:142)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9355 lines...]
[junit4:junit4] Suite: org.apache.solr.update.processor.RegexBoostProcessorTest
[junit4:junit4] 2> 661722 T1662 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672
[junit4:junit4] 2> 661723 T1662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4] 2> 661724 T1662 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 661725 T1662 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4] 2> 661811 T1662 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 661926 T1662 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 661927 T1662 oass.IndexSchema.readSchema Reading Solr Schema from schema12.xml
[junit4:junit4] 2> 661933 T1662 oass.IndexSchema.readSchema [null] Schema name=test
[junit4:junit4] 2> 662454 T1662 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 662458 T1662 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 662460 T1662 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (2)
[junit4:junit4] 2> 662470 T1662 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 662474 T1662 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 662479 T1662 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 662479 T1662 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr
[junit4:junit4] 2> 662479 T1662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/'
[junit4:junit4] 2> 662494 T1662 oasc.CoreContainer.<init> New CoreContainer 478129655
[junit4:junit4] 2> 662544 T1662 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 662545 T1662 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672/
[junit4:junit4] 2> 662545 T1662 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f8d0141
[junit4:junit4] 2> 662546 T1662 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 662547 T1662 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672
[junit4:junit4] 2> 662547 T1662 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672/index/
[junit4:junit4] 2> 662547 T1662 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 662548 T1662 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672/index
[junit4:junit4] 2> 662550 T1662 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@f64035a lockFactory=org.apache.lucene.store.NativeFSLockFactory@6efe6792)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 662551 T1662 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 662552 T1662 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 662554 T1662 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 662554 T1662 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 662555 T1662 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 662555 T1662 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 662556 T1662 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 662557 T1662 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 662557 T1662 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 662558 T1662 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 662558 T1662 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 662559 T1662 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 662560 T1662 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 662560 T1662 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 662561 T1662 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 662561 T1662 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 662561 T1662 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 662562 T1662 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 662563 T1662 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 662563 T1662 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 662564 T1662 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 662564 T1662 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 662565 T1662 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 662566 T1662 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 662566 T1662 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 662567 T1662 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 662567 T1662 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 662568 T1662 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 662580 T1662 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 662584 T1662 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 662586 T1662 oasc.SolrCore.initDeprecatedSupport WARN adding ShowFileRequestHandler with hidden files: [THROW.ERROR.ON.ADD.UPDATEPROCESSOR.JS, SOLRCONFIG-HIGHLIGHT.XML, SCHEMA-REQUIRED-FIELDS.XML, SCHEMA-MINIMAL.XML, SCHEMA-REPLICATION2.XML, BAD-SCHEMA-DOCVALUES-NOT-REQUIRED-NO-DEFAULT.XML, TRIVIAL.UPDATEPROCESSOR1.JS, BAD-SCHEMA-DUP-DYNAMICFIELD.XML, SOLRCONFIG-CACHING.XML, SCHEMA-POSTINGSHIGHLIGHT.XML, BAD-SOLRCONFIG-UNEXPECTED-SCHEMA-ATTRIBUTE.XML, SOLRCONFIG-REPEATER.XML, REGEX-BOOST-PROCESSOR-TEST.TXT, CURRENCY.XML, BAD-SCHEMA-NONTEXT-ANALYZER.XML, SOLRCONFIG-MERGEPOLICY.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-CODE-IN-XML.XML, SOLRCONFIG-TLOG.XML, SOLRCONFIG-MASTER.XML, SOLRCONFIG-COMPONENTS-NAME.XML, BAD-SCHEMA-UNIQUEKEY-MULTIVALUED.XML, SCHEMA11.XML, SOLRCONFIG-BASIC.XML, DA_COMPOUNDDICTIONARY.TXT, MISSLEADING.EXTENSION.UPDATEPROCESSOR.JS.TXT, SCHEMA-COPYFIELD-TEST.XML, SOLRCONFIG-SLAVE.XML, SOLRCONFIG-PROPINJECT-INDEXDEFAULT.XML, ELEVATE.XML, TRIVIAL.UPDATEPROCESSOR0.JS, SCHEMA-SWEETSPOT.XML, BAD-SOLRCONFIG-BOGUS-SCRIPTENGINE-NAME.XML, SCHEMA-CHARFILTERS.XML, SCHEMA-IB.XML, BAD-SCHEMA-MISPLACED-ASTERISK-COPYFIELD-SOURCE-SHOULD-FAIL-TEST.XML, SOLRCONFIG-QUERYSENDER.XML, DA_UTF8.XML, SOLRCONFIG-SNIPPET-PROCESSOR.XML, SCHEMA-REPLICATION1.XML, BAD-SCHEMA-NON-GLOB-COPYFIELD-SOURCE-MATCHING-NOTHING-SHOULD-FAIL-TEST.XML, CONDITIONAL.UPDATEPROCESSOR.JS, SCHEMA-TINY.XML, MISSING.FUNCTIONS.UPDATEPROCESSOR.JS, SOLRCONFIG-ENABLEPLUGIN.XML, HYPHENATION.DTD, BAD-SOLRCONFIG-SCHEMA-MUTABLE-BUT-NOT-MANAGED.XML, STEMDICT.TXT, SCHEMA-PHRASESUGGEST.XML, SCHEMA-ID-AND-VERSION-FIELDS-ONLY.XML, HUNSPELL-TEST.AFF, BAD-SCHEMA-CURRENCY-FT-OER-NORATES.XML, SCHEMA-SNIPPET-TYPE.XML, STOPTYPES-1.TXT, STOPWORDSWRONGENCODING.TXT, SCHEMA-NUMERIC.XML, SOLRCONFIG-TRANSFORMERS.XML, SOLRCONFIG-PROPINJECT.XML, BAD-SCHEMA-NOT-INDEXED-BUT-TF.XML, SOLRCONFIG-SIMPLELOCK.XML, SOLRCONFIG-TLOG-MUTABLE-MANAGED-SCHEMA.XML, SCHEMA-DOCVALUES.XML, WDFTYPES.TXT, SCHEMA-REVERSED.XML, STOPTYPES-2.TXT, BAD-SCHEMA-CURRENCY-FT-MULTIVALUED.XML, BAD-SCHEMA-BOGUS-ANALYSIS-PARAMETERS.XML, SOLRCONFIG-SPELLCHECKCOMPONENT.XML, BAD-SCHEMA-CURRENCY-MULTIVALUED.XML, SOLRCONFIG-PHRASESUGGEST.XML, SCHEMA-DFR.XML, BAD-SCHEMA-NOT-INDEXED-BUT-POS.XML, KEEP-1.TXT, SCHEMA-SPATIAL.XML, OPEN-EXCHANGE-RATES.JSON, STOPWITHBOM.TXT, SCHEMA-BINARYFIELD.XML, SOLRCONFIG-POSTINGSHIGHLIGHT.XML, SOLRCONFIG-SPELLCHECKER.XML, SOLRCONFIG-WARMER.XML, SOLRCONFIG-UPDATE-PROCESSOR-CHAINS.XML, BAD-SCHEMA-OMIT-TF-BUT-NOT-POS.XML, BAD-SCHEMA-DUP-FIELDTYPE.XML, SCHEMA-XINCLUDE.XML, SOLRCONFIG-MASTER1.XML, BAD-SCHEMA-MULTIPLE-ASTERISK-COPYFIELD-SOURCE-SHOULD-FAIL-TEST.XML, SCHEMA-BEHAVIOR.XML, SYNONYMS.TXT, SOLRCONFIG-MINIMAL.XML, SCHEMA-DOCVALUESMULTI.XML, BAD-SCHEMA-UNSUPPORTED-DOCVALUES.XML, BAD-SCHEMA-CURRENCY-DYNAMIC-MULTIVALUED.XML, SCHEMA_CODEC.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-HYPERBOLIC.XML, SOLRCONFIG-SOLR-749.XML, SCHEMA-EFF.XML, SOLRCONFIG-MASTER1-KEEPONEBACKUP.XML, SOLRCONFIG-FUNCTIONQUERY.XML, STOP-2.TXT, SCHEMA-LMDIRICHLET.XML, SOLRCONFIG-TERMINDEX.XML, SCHEMA-ONE-FIELD-NO-DYNAMIC-FIELD.XML, SOLRCONFIG-ELEVATE.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-NORMS.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-BASELINE.XML, SCHEMA-FOLDING.XML, STOPWORDS.TXT, SCHEMA-STOP-KEEP.XML, BAD-SCHEMA-BOGUS-FIELD-PARAMETERS.XML, FUZZYSUGGEST.TXT, BAD-SOLRCONFIG-MANAGED-SCHEMA-NAMED-SCHEMA.XML.XML, BAD-SCHEMA-NOT-INDEXED-BUT-NORMS.XML, SCHEMA-REST.XML, SOLRCONFIG-SOLCOREPROPERTIES.XML, SOLRCONFIG-TLOG-MANAGED-SCHEMA.XML, STOP-1.TXT, SOLRCONFIG-MANAGED-SCHEMA.XML, SOLRCONFIG-MASTER2.XML, SCHEMA-SPELLCHECKER.XML, SOLRCONFIG-RESPONSE-LOG-COMPONENT.XML, BAD-SCHEMA-MISPLACED-ASTERISK-COPYFIELD-DEST-SHOULD-FAIL-TEST.XML, SOLRCONFIG-LAZYWRITER.XML, SCHEMA-LUCENEMATCHVERSION.XML, SCHEMA-CLASS-NAME-SHORTENING-ON-SERIALIZATION.XML, FRENCHARTICLES.TXT, BAD-MP-SOLRCONFIG.XML, SCHEMA15.XML, SOLRCONFIG-REQHANDLER.INCL, SCHEMASURROUND.XML, SCHEMA-COLLATEFILTER.XML, SOLRCONFIG-MASTER3.XML, BAD-SCHEMA-MULTIPLE-ASTERISK-COPYFIELD-DEST-SHOULD-FAIL-TEST.XML, HUNSPELL-TEST.DIC, BAD-SCHEMA-CODEC-GLOBAL-VS-FT-MISMATCH.XML, SOLRCONFIG-XINCLUDE.XML, SOLRCONFIG-SLAVE1.XML, SOLRCONFIG-DELPOLICY1.XML, SCHEMA-SIM.XML, SCHEMA-SNIPPET-FIELD.XML, SCHEMA-COLLATE.XML, STOP-SNOWBALL.TXT, BAD-SCHEMA-SIM-GLOBAL-VS-FT-MISMATCH.XML, PROTWORDS.TXT, SCHEMA-TRIE.XML, SOLRCONFIG_CODEC.XML, SCHEMA-SYNONYM-TOKENIZER.XML, BAD-SOLRCONFIG-INVALID-SCRIPTFILE.XML, JASUGGEST.TXT, SCHEMA-REST-LUCENE-MATCH-VERSION.XML, SCHEMA-DOCVALUESFACETING.XML, SCHEMA-TFIDF.XML, SOLRCONFIG-SCRIPT-UPDATEPROCESSOR.XML, SCHEMA-LMJELINEKMERCER.XML, PHRASESUGGEST.TXT, BAD-SOLRCONFIG-MISSING-SCRIPTFILE.XML, SOLRCONFIG-BASIC-LUCENEVERSION31.XML, BAD-SCHEMA-UNIQUEKEY-USES-DEFAULT.XML, OLD_SYNONYMS.TXT, SOLRCONFIG-DELPOLICY2.XML, SOLRCONFIG-NATIVELOCK.XML, XSLT, BAD-SCHEMA-DUP-FIELD.XML, SOLRCONFIG-MUTABLE-MANAGED-SCHEMA.XML, SOLRCONFIG-NOCACHE.XML, BAD-SCHEMA-SWEETSPOT-BOTH-TF.XML, SCHEMA-BM25.XML, ADDFIELDS.UPDATEPROCESSOR.JS, SOLRCONFIG-QUERYSENDER-NOQUERY.XML, SOLRCONFIG-ALTDIRECTORY.XML, COMPOUNDDICTIONARY.TXT, BAD-CURRENCY.XML, SOLRCONFIG-INDEXCONFIG.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-DEFAULT-CODE.XML, SOLRCONFIG_PERF.XML, SCHEMA-NOT-REQUIRED-UNIQUE-KEY.XML, BAD-SCHEMA-ANALYZER-CLASS-AND-NESTED.XML, KEEP-2.TXT, SCHEMA12.XML, BAD-SCHEMA-UNIQUEKEY-IS-COPYFIELD-DEST.XML, MAPPING-ISOLATIN1ACCENT.TXT, BAD_SOLRCONFIG.XML, BAD-SCHEMA-EXTERNAL-FILEFIELD.XML]
[junit4:junit4] 2> 662589 T1662 oass.SolrIndexSearcher.<init> Opening Searcher@2f11208d main
[junit4:junit4] 2> 662590 T1662 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 662590 T1662 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 662591 T1662 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 662597 T1662 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 662661 T1663 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f11208d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 662667 T1662 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 662679 T1662 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4] 2> 662690 T1662 oas.SolrTestCaseJ4.setUp ###Starting testNoBoost
[junit4:junit4] 2> 662690 T1662 oas.SolrTestCaseJ4.tearDown ###Ending testNoBoost
[junit4:junit4] 2> 662695 T1662 oas.SolrTestCaseJ4.setUp ###Starting testTwoRules
[junit4:junit4] 2> 662696 T1662 oas.SolrTestCaseJ4.tearDown ###Ending testTwoRules
[junit4:junit4] 2> 662700 T1662 oas.SolrTestCaseJ4.setUp ###Starting testDeboostOld
[junit4:junit4] 2> 662701 T1662 oas.SolrTestCaseJ4.tearDown ###Ending testDeboostOld
[junit4:junit4] 2> 662706 T1662 oas.SolrTestCaseJ4.setUp ###Starting testBoostGood
[junit4:junit4] 2> 662706 T1662 oas.SolrTestCaseJ4.tearDown ###Ending testBoostGood
[junit4:junit4] 2> 662707 T1662 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 662708 T1662 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=478129655
[junit4:junit4] 2> 662708 T1662 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@27641bf
[junit4:junit4] 2> 662718 T1662 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 662718 T1662 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 662719 T1662 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 662719 T1662 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 662720 T1662 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 662720 T1662 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 662720 T1662 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672/index;done=false>>]
[junit4:junit4] 2> 662721 T1662 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672/index
[junit4:junit4] 2> 662721 T1662 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672;done=false>>]
[junit4:junit4] 2> 662721 T1662 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-RegexBoostProcessorTest-1368660055672
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=mk, timezone=America/Godthab
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=1,free=137792384,total=488636416
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestJmxMonitoredMap, TestZkChroot, DocumentAnalysisRequestHandlerTest, TestSolrJ, ScriptEngineTest, TestFastOutputStream, WordBreakSolrSpellCheckerTest, SliceStateTest, TestFiltering, TestTrie, TestPHPSerializedResponseWriter, TestSolrDeletionPolicy1, TestUtils, DirectUpdateHandlerOptimizeTest, MinimalSchemaTest, CircularListTest, ResponseLogComponentTest, ChaosMonkeySafeLeaderTest, EchoParamsTest, ClusterStateUpdateTest, PathHierarchyTokenizerFactoryTest, DebugComponentTest, SpellCheckComponentTest, DisMaxRequestHandlerTest, TestLuceneMatchVersion, PrimUtilsTest, CurrencyFieldOpenExchangeTest, TestSolrQueryParserResource, TestFastLRUCache, TestSweetSpotSimilarityFactory, ShowFileRequestHandlerTest, TestPartialUpdateDeduplication, SimpleFacetsTest, TestCoreContainer, BasicDistributedZkTest, TestLMDirichletSimilarityFactory, TestStressLucene, OverseerCollectionProcessorTest, UUIDFieldTest, DocValuesTest, TestCollationKeyRangeQueries, TestLFUCache, TestPropInject, TestPerFieldSimilarity, TestSuggestSpellingConverter, SuggesterTSTTest, TestSurroundQueryParser, ShardRoutingTest, RegexBoostProcessorTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RegexBoostProcessorTest -Dtests.seed=30F79478D1F21737 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mk -Dtests.timezone=America/Godthab -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 0.00s J1 | RegexBoostProcessorTest (suite) <<<
[junit4:junit4] > Throwable #1: junit.framework.AssertionFailedError: Clean up static fields (in @AfterClass?), your test seems to hang on to approximately 24,564,080 bytes (threshold is 10,485,760). Field reference sizes (counted individually):
[junit4:junit4] > - 25,128,200 bytes, protected static org.apache.solr.servlet.SolrRequestParsers org.apache.solr.update.processor.RegexBoostProcessorTest._parser
[junit4:junit4] > - 5,192 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessorFactory org.apache.solr.update.processor.RegexBoostProcessorTest.factory
[junit4:junit4] > - 4,520 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessor org.apache.solr.update.processor.RegexBoostProcessorTest.reProcessor
[junit4:junit4] > - 816 bytes, protected static org.apache.solr.common.params.ModifiableSolrParams org.apache.solr.update.processor.RegexBoostProcessorTest.parameters
[junit4:junit4] > - 280 bytes, public static org.junit.rules.TestRule org.apache.solr.SolrTestCaseJ4.solrClassRules
[junit4:junit4] > - 248 bytes, protected static java.lang.String org.apache.solr.SolrTestCaseJ4.testSolrHome
[junit4:junit4] > - 128 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.factoryProp
[junit4:junit4] > - 64 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.coreName
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([30F79478D1F21737]:0)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] Completed on J1 in 2.19s, 4 tests, 1 failure <<< FAILURES!
[...truncated 257 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 1005815 T2320 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /wzl/
[junit4:junit4] 2> 1005821 T2320 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1368660399772
[junit4:junit4] 2> 1005822 T2320 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1005823 T2321 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1005924 T2320 oasc.ZkTestServer.run start zk server on port:15864
[junit4:junit4] 2> 1005926 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1005930 T2327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c79ab4 name:ZooKeeperConnection Watcher:127.0.0.1:15864 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1005930 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1005931 T2320 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1005964 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1005997 T2329 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7dcc5312 name:ZooKeeperConnection Watcher:127.0.0.1:15864/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1005998 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1005999 T2320 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1006004 T2320 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1006036 T2320 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1006039 T2320 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1006042 T2320 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1006043 T2320 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1006049 T2320 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1006050 T2320 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1006155 T2320 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1006156 T2320 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1006168 T2320 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1006169 T2320 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1006198 T2320 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1006199 T2320 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1006203 T2320 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1006204 T2320 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1006210 T2320 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1006211 T2320 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1006214 T2320 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1006215 T2320 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1006218 T2320 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1006219 T2320 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1006436 T2320 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1006443 T2320 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:15867
[junit4:junit4] 2> 1006444 T2320 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1006444 T2320 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1006445 T2320 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368660400180
[junit4:junit4] 2> 1006446 T2320 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368660400180/solr.xml
[junit4:junit4] 2> 1006446 T2320 oasc.CoreContainer.<init> New CoreContainer 410527114
[junit4:junit4] 2> 1006447 T2320 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368660400180/'
[junit4:junit4] 2> 1006448 T2320 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368660400180/'
[junit4:junit4] 2> 1006566 T2320 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1006567 T2320 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1006568 T2320 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1006568 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1006569 T2320 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1006569 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1006570 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1006570 T2320 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1006571 T2320 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1006572 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1006588 T2320 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1006589 T2320 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:15864/solr
[junit4:junit4] 2> 1006590 T2320 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1006591 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1006594 T2340 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@786f0db2 name:ZooKeeperConnection Watcher:127.0.0.1:15864 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1006594 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1006598 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1006611 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1006613 T2342 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66034227 name:ZooKeeperConnection Watcher:127.0.0.1:15864/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1006613 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1006616 T2320 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1006627 T2320 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1006632 T2320 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1006634 T2320 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:15867_wzl
[junit4:junit4] 2> 1006636 T2320 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:15867_wzl
[junit4:junit4] 2> 1006645 T2320 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1006659 T2320 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1006662 T2320 oasc.Overseer.start Overseer (id=89696527959851011-127.0.0.1:15867_wzl-n_0000000000) starting
[junit4:junit4] 2> 1006673 T2320 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1006683 T2344 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1006684 T2320 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1006687 T2320 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1006694 T2320 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1006697 T2343 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1006702 T2345 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368660400180/collection1
[junit4:junit4] 2> 1006702 T2345 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1006703 T2345 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1006703 T2345 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1006704 T2345 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368660400180/collection1/'
[junit4:junit4] 2> 1006706 T2345 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1368660400180/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1006707 T2345 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1368660400180/collection1/lib/README' to classloader
[junit4:junit4] 2> 1006794 T2345 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1006858 T2345 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1006959 T2345 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1006966 T2345 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1007575 T2345 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1007579 T2345 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1007582 T2345 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1007588 T2345 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1007635 T2345 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1007635 T2345 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368660400180/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368660399771/control/data/
[junit4:junit4] 2> 1007636 T2345 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f8d0141
[junit4:junit4] 2> 1007636 T2345 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1007637 T2345 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/control/data
[junit4:junit4] 2> 1007638 T2345 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368660399771/control/data/index/
[junit4:junit4] 2> 1007638 T2345 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368660399771/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1007638 T2345 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/control/data/index
[junit4:junit4] 2> 1007643 T2345 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5e66e561 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47013dd8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1007643 T2345 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1007646 T2345 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1007647 T2345 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1007647 T2345 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1007648 T2345 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1007649 T2345 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1007649 T2345 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1007649 T2345 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1007650 T2345 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1007651 T2345 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1007664 T2345 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1007671 T2345 oass.SolrIndexSearcher.<init> Opening Searcher@1b494b65 main
[junit4:junit4] 2> 1007671 T2345 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368660399771/control/data/tlog
[junit4:junit4] 2> 1007673 T2345 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1007673 T2345 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1007677 T2346 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b494b65 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1007679 T2345 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1007679 T2345 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1008202 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1008203 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:15867_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:15867/wzl"}
[junit4:junit4] 2> 1008203 T2343 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1008203 T2343 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1008218 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1008707 T2345 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1008707 T2345 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:15867/wzl collection:control_collection shard:shard1
[junit4:junit4] 2> 1008708 T2345 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1008727 T2345 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1008732 T2345 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1008732 T2345 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1008732 T2345 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:15867/wzl/collection1/
[junit4:junit4] 2> 1008733 T2345 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1008733 T2345 oasc.SyncStrategy.syncToMe http://127.0.0.1:15867/wzl/collection1/ has no replicas
[junit4:junit4] 2> 1008733 T2345 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:15867/wzl/collection1/
[junit4:junit4] 2> 1008734 T2345 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1009723 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1009768 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1009812 T2345 oasc.ZkController.register We are http://127.0.0.1:15867/wzl/collection1/ and leader is http://127.0.0.1:15867/wzl/collection1/
[junit4:junit4] 2> 1009812 T2345 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:15867/wzl
[junit4:junit4] 2> 1009812 T2345 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1009813 T2345 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1009813 T2345 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1009815 T2345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1009816 T2320 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1009817 T2320 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1009818 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1009832 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1009833 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1009836 T2349 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fbfdee0 name:ZooKeeperConnection Watcher:127.0.0.1:15864/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1009836 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1009838 T2320 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1009840 T2320 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1010044 T2320 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1010047 T2320 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:15872
[junit4:junit4] 2> 1010048 T2320 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1010048 T2320 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1010049 T2320 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368660403791
[junit4:junit4] 2> 1010049 T2320 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368660403791/solr.xml
[junit4:junit4] 2> 1010050 T2320 oasc.CoreContainer.<init> New CoreContainer 1800435240
[junit4:junit4] 2> 1010051 T2320 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368660403791/'
[junit4:junit4] 2> 1010051 T2320 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368660403791/'
[junit4:junit4] 2> 1010170 T2320 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1010171 T2320 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1010172 T2320 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1010173 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1010173 T2320 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1010174 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1010174 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1010175 T2320 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1010175 T2320 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1010176 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1010190 T2320 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1010191 T2320 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:15864/solr
[junit4:junit4] 2> 1010192 T2320 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1010193 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1010196 T2360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58536845 name:ZooKeeperConnection Watcher:127.0.0.1:15864 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1010197 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1010212 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1010223 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1010225 T2362 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67fecd46 name:ZooKeeperConnection Watcher:127.0.0.1:15864/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1010225 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1010230 T2320 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1011234 T2320 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:15872_wzl
[junit4:junit4] 2> 1011237 T2320 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:15872_wzl
[junit4:junit4] 2> 1011240 T2349 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1011241 T2362 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1011241 T2342 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1011241 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1011248 T2363 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368660403791/collection1
[junit4:junit4] 2> 1011249 T2363 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1011249 T2363 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1011250 T2363 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1011251 T2363 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368660403791/collection1/'
[junit4:junit4] 2> 1011252 T2363 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1368660403791/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1011253 T2363 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1368660403791/collection1/lib/README' to classloader
[junit4:junit4] 2> 1011281 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1011282 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:15867_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:15867/wzl"}
[junit4:junit4] 2> 1011294 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1011294 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1011294 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1011306 T2363 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1011368 T2363 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1011469 T2363 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1011475 T2363 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1012059 T2363 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1012063 T2363 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1012065 T2363 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1012071 T2363 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1012094 T2363 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1012095 T2363 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368660403791/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty1/
[junit4:junit4] 2> 1012095 T2363 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f8d0141
[junit4:junit4] 2> 1012096 T2363 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1012096 T2363 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty1
[junit4:junit4] 2> 1012097 T2363 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty1/index/
[junit4:junit4] 2> 1012097 T2363 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1012098 T2363 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty1/index
[junit4:junit4] 2> 1012101 T2363 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c4dcbaf lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb9fd94),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1012101 T2363 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1012104 T2363 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1012105 T2363 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1012106 T2363 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1012106 T2363 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1012107 T2363 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1012107 T2363 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1012108 T2363 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1012109 T2363 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1012109 T2363 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1012122 T2363 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1012128 T2363 oass.SolrIndexSearcher.<init> Opening Searcher@32eafd80 main
[junit4:junit4] 2> 1012129 T2363 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty1/tlog
[junit4:junit4] 2> 1012130 T2363 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1012130 T2363 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1012134 T2364 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32eafd80 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1012136 T2363 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1012137 T2363 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1012798 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1012799 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:15872_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:15872/wzl"}
[junit4:junit4] 2> 1012799 T2343 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1012799 T2343 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1012840 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1012840 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1012840 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1013169 T2363 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1013169 T2363 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:15872/wzl collection:collection1 shard:shard1
[junit4:junit4] 2> 1013170 T2363 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1013187 T2363 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1013189 T2363 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1013190 T2363 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1013190 T2363 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:15872/wzl/collection1/
[junit4:junit4] 2> 1013190 T2363 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1013191 T2363 oasc.SyncStrategy.syncToMe http://127.0.0.1:15872/wzl/collection1/ has no replicas
[junit4:junit4] 2> 1013191 T2363 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:15872/wzl/collection1/
[junit4:junit4] 2> 1013191 T2363 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1014344 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1014367 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1014367 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1014367 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1014370 T2363 oasc.ZkController.register We are http://127.0.0.1:15872/wzl/collection1/ and leader is http://127.0.0.1:15872/wzl/collection1/
[junit4:junit4] 2> 1014370 T2363 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:15872/wzl
[junit4:junit4] 2> 1014370 T2363 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1014371 T2363 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1014371 T2363 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1014373 T2363 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1014375 T2320 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1014376 T2320 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1014376 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1014598 T2320 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1014601 T2320 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:15875
[junit4:junit4] 2> 1014602 T2320 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1014602 T2320 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1014603 T2320 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368660408341
[junit4:junit4] 2> 1014604 T2320 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368660408341/solr.xml
[junit4:junit4] 2> 1014604 T2320 oasc.CoreContainer.<init> New CoreContainer 1243887470
[junit4:junit4] 2> 1014605 T2320 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368660408341/'
[junit4:junit4] 2> 1014605 T2320 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368660408341/'
[junit4:junit4] 2> 1014724 T2320 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1014726 T2320 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1014726 T2320 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1014727 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1014727 T2320 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1014728 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1014728 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1014729 T2320 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1014730 T2320 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1014730 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1014746 T2320 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1014747 T2320 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:15864/solr
[junit4:junit4] 2> 1014748 T2320 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1014749 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1014752 T2376 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3619b1ff name:ZooKeeperConnection Watcher:127.0.0.1:15864 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1014753 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1014766 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1014778 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1014780 T2378 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@156c0eb4 name:ZooKeeperConnection Watcher:127.0.0.1:15864/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1014780 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1014789 T2320 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1015793 T2320 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:15875_wzl
[junit4:junit4] 2> 1015804 T2320 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:15875_wzl
[junit4:junit4] 2> 1015830 T2378 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1015830 T2362 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1015831 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1015830 T2349 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1015830 T2342 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1015831 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1015832 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1015839 T2379 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368660408341/collection1
[junit4:junit4] 2> 1015839 T2379 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1015840 T2379 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1015840 T2379 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1015841 T2379 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368660408341/collection1/'
[junit4:junit4] 2> 1015843 T2379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1368660408341/collection1/lib/README' to classloader
[junit4:junit4] 2> 1015843 T2379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1368660408341/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1015873 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1015874 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:15872_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:15872/wzl"}
[junit4:junit4] 2> 1015879 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1015879 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1015879 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1015879 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1015895 T2379 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1015956 T2379 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1016058 T2379 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1016064 T2379 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1016647 T2379 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1016651 T2379 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1016654 T2379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1016659 T2379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1016682 T2379 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1016682 T2379 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368660408341/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty2/
[junit4:junit4] 2> 1016683 T2379 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f8d0141
[junit4:junit4] 2> 1016683 T2379 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1016685 T2379 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty2
[junit4:junit4] 2> 1016685 T2379 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty2/index/
[junit4:junit4] 2> 1016685 T2379 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1016686 T2379 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty2/index
[junit4:junit4] 2> 1016689 T2379 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b6df51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53e07963),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1016689 T2379 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1016692 T2379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1016693 T2379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1016694 T2379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1016694 T2379 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1016695 T2379 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1016695 T2379 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1016696 T2379 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1016697 T2379 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1016697 T2379 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1016710 T2379 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1016716 T2379 oass.SolrIndexSearcher.<init> Opening Searcher@1d352fc6 main
[junit4:junit4] 2> 1016717 T2379 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty2/tlog
[junit4:junit4] 2> 1016718 T2379 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1016718 T2379 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1016723 T2380 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d352fc6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1016725 T2379 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1016725 T2379 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1017414 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1017415 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:15875_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:15875/wzl"}
[junit4:junit4] 2> 1017415 T2343 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1017416 T2343 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1017445 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1017445 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1017445 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1017445 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1017754 T2379 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1017754 T2379 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:15875/wzl collection:collection1 shard:shard2
[junit4:junit4] 2> 1017755 T2379 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1017772 T2379 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1017783 T2379 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1017783 T2379 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1017784 T2379 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:15875/wzl/collection1/
[junit4:junit4] 2> 1017784 T2379 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1017784 T2379 oasc.SyncStrategy.syncToMe http://127.0.0.1:15875/wzl/collection1/ has no replicas
[junit4:junit4] 2> 1017785 T2379 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:15875/wzl/collection1/
[junit4:junit4] 2> 1017785 T2379 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1018956 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1018974 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1018974 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1018974 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1018974 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1019023 T2379 oasc.ZkController.register We are http://127.0.0.1:15875/wzl/collection1/ and leader is http://127.0.0.1:15875/wzl/collection1/
[junit4:junit4] 2> 1019023 T2379 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:15875/wzl
[junit4:junit4] 2> 1019023 T2379 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1019024 T2379 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1019024 T2379 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1019025 T2379 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1019027 T2320 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1019027 T2320 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1019028 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1019248 T2320 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1019252 T2320 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:47424
[junit4:junit4] 2> 1019253 T2320 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1019253 T2320 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1019254 T2320 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368660412992
[junit4:junit4] 2> 1019254 T2320 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368660412992/solr.xml
[junit4:junit4] 2> 1019255 T2320 oasc.CoreContainer.<init> New CoreContainer 1283427932
[junit4:junit4] 2> 1019256 T2320 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368660412992/'
[junit4:junit4] 2> 1019256 T2320 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368660412992/'
[junit4:junit4] 2> 1019375 T2320 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1019376 T2320 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1019377 T2320 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1019377 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1019378 T2320 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1019379 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1019379 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1019380 T2320 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1019380 T2320 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1019381 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1019395 T2320 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1019396 T2320 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:15864/solr
[junit4:junit4] 2> 1019397 T2320 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1019398 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1019401 T2392 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2496fd26 name:ZooKeeperConnection Watcher:127.0.0.1:15864 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1019401 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1019416 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1019427 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1019429 T2394 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d26d3b5 name:ZooKeeperConnection Watcher:127.0.0.1:15864/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1019429 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1019434 T2320 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1020438 T2320 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47424_wzl
[junit4:junit4] 2> 1020440 T2320 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47424_wzl
[junit4:junit4] 2> 1020444 T2349 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1020444 T2378 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1020444 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1020444 T2394 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1020444 T2342 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1020444 T2362 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1020445 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1020445 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1020446 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1020458 T2395 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368660412992/collection1
[junit4:junit4] 2> 1020458 T2395 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1020459 T2395 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1020459 T2395 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1020461 T2395 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368660412992/collection1/'
[junit4:junit4] 2> 1020462 T2395 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1368660412992/collection1/lib/README' to classloader
[junit4:junit4] 2> 1020463 T2395 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1368660412992/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1020486 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1020487 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:15875_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:15875/wzl"}
[junit4:junit4] 2> 1020500 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1020500 T2394 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1020500 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1020500 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1020500 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1020516 T2395 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1020581 T2395 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1020682 T2395 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1020688 T2395 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1021266 T2395 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1021269 T2395 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1021270 T2395 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1021274 T2395 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1021293 T2395 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1021293 T2395 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368660412992/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3/
[junit4:junit4] 2> 1021294 T2395 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f8d0141
[junit4:junit4] 2> 1021294 T2395 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1021295 T2395 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3
[junit4:junit4] 2> 1021295 T2395 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3/index/
[junit4:junit4] 2> 1021295 T2395 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1021296 T2395 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3/index
[junit4:junit4] 2> 1021299 T2395 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7e11f696 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53632e03),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1021299 T2395 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1021301 T2395 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1021301 T2395 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1021302 T2395 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1021303 T2395 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1021303 T2395 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1021303 T2395 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1021304 T2395 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1021304 T2395 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1021304 T2395 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1021313 T2395 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1021317 T2395 oass.SolrIndexSearcher.<init> Opening Searcher@7cd6f2c7 main
[junit4:junit4] 2> 1021317 T2395 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3/tlog
[junit4:junit4] 2> 1021318 T2395 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1021318 T2395 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1021321 T2396 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7cd6f2c7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1021323 T2395 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1021323 T2395 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1022005 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1022006 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47424_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47424/wzl"}
[junit4:junit4] 2> 1022006 T2343 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1022007 T2343 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1022036 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1022036 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1022036 T2394 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1022036 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1022036 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1022341 T2395 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1022341 T2395 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47424/wzl collection:collection1 shard:shard1
[junit4:junit4] 2> 1022345 T2395 oasc.ZkController.register We are http://127.0.0.1:47424/wzl/collection1/ and leader is http://127.0.0.1:15872/wzl/collection1/
[junit4:junit4] 2> 1022345 T2395 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47424/wzl
[junit4:junit4] 2> 1022345 T2395 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1022346 T2395 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C126 name=collection1 org.apache.solr.core.SolrCore@3ce6cdad url=http://127.0.0.1:47424/wzl/collection1 node=127.0.0.1:47424_wzl C126_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:47424_wzl, base_url=http://127.0.0.1:47424/wzl}
[junit4:junit4] 2> 1022346 T2397 C126 P47424 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1022347 T2395 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1022348 T2397 C126 P47424 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1022349 T2397 C126 P47424 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1022349 T2397 C126 P47424 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1022349 T2320 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1022350 T2320 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1022351 T2397 C126 P47424 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1022351 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1022372 T2352 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1022579 T2320 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1022582 T2320 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:46695
[junit4:junit4] 2> 1022583 T2320 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1022584 T2320 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1022584 T2320 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368660416321
[junit4:junit4] 2> 1022585 T2320 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368660416321/solr.xml
[junit4:junit4] 2> 1022586 T2320 oasc.CoreContainer.<init> New CoreContainer 916674900
[junit4:junit4] 2> 1022586 T2320 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368660416321/'
[junit4:junit4] 2> 1022587 T2320 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368660416321/'
[junit4:junit4] 2> 1022705 T2320 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1022706 T2320 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1022706 T2320 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1022707 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1022707 T2320 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1022708 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1022708 T2320 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1022709 T2320 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1022709 T2320 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1022710 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1022726 T2320 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1022727 T2320 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:15864/solr
[junit4:junit4] 2> 1022727 T2320 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1022729 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1022731 T2409 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6167b1a8 name:ZooKeeperConnection Watcher:127.0.0.1:15864 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1022732 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1022735 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1022747 T2320 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1022749 T2411 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48c3a2ae name:ZooKeeperConnection Watcher:127.0.0.1:15864/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1022749 T2320 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1022761 T2320 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1023549 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1023550 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47424_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47424/wzl"}
[junit4:junit4] 2> 1023565 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1023565 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1023565 T2411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1023565 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1023565 T2394 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1023565 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1023764 T2320 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46695_wzl
[junit4:junit4] 2> 1023766 T2320 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46695_wzl
[junit4:junit4] 2> 1023769 T2411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1023769 T2378 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1023769 T2394 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1023769 T2342 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1023769 T2349 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1023769 T2362 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1023770 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1023770 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1023770 T2394 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1023770 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1023771 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1023771 T2411 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1023787 T2412 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368660416321/collection1
[junit4:junit4] 2> 1023787 T2412 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1023788 T2412 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1023788 T2412 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1023789 T2412 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368660416321/collection1/'
[junit4:junit4] 2> 1023791 T2412 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1368660416321/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1023791 T2412 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1368660416321/collection1/lib/README' to classloader
[junit4:junit4] 2> 1023844 T2412 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1023931 T2412 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1024033 T2412 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1024039 T2412 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1024375 T2352 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1024375 T2352 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:47424_wzl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 1024669 T2412 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1024673 T2412 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1024676 T2412 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1024682 T2412 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1024705 T2412 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1024706 T2412 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368660416321/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4/
[junit4:junit4] 2> 1024706 T2412 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f8d0141
[junit4:junit4] 2> 1024707 T2412 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1024708 T2412 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4
[junit4:junit4] 2> 1024708 T2412 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4/index/
[junit4:junit4] 2> 1024708 T2412 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1024710 T2412 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4/index
[junit4:junit4] 2> 1024713 T2412 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73307b82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@180bb0b1),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1024714 T2412 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1024717 T2412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1024717 T2412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1024718 T2412 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1024719 T2412 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1024720 T2412 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1024720 T2412 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1024720 T2412 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1024721 T2412 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1024722 T2412 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1024736 T2412 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1024743 T2412 oass.SolrIndexSearcher.<init> Opening Searcher@38efac26 main
[junit4:junit4] 2> 1024744 T2412 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4/tlog
[junit4:junit4] 2> 1024745 T2412 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1024745 T2412 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1024750 T2413 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@38efac26 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1024752 T2412 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1024752 T2412 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1025072 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1025073 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46695_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46695/wzl"}
[junit4:junit4] 2> 1025073 T2343 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1025073 T2343 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1025079 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1025079 T2394 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1025079 T2411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1025079 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1025079 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1025079 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1025755 T2412 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1025755 T2412 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46695/wzl collection:collection1 shard:shard2
[junit4:junit4] 2> 1025759 T2412 oasc.ZkController.register We are http://127.0.0.1:46695/wzl/collection1/ and leader is http://127.0.0.1:15875/wzl/collection1/
[junit4:junit4] 2> 1025759 T2412 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46695/wzl
[junit4:junit4] 2> 1025760 T2412 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1025760 T2412 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C127 name=collection1 org.apache.solr.core.SolrCore@53f6603f url=http://127.0.0.1:46695/wzl/collection1 node=127.0.0.1:46695_wzl C127_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:46695_wzl, base_url=http://127.0.0.1:46695/wzl}
[junit4:junit4] 2> 1025760 T2414 C127 P46695 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1025761 T2412 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1025762 T2414 C127 P46695 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1025762 T2414 C127 P46695 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1025763 T2414 C127 P46695 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1025763 T2320 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1025764 T2320 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1025765 T2320 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1025791 T2414 C127 P46695 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1025793 T2320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1025794 T2320 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1025795 T2320 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1025796 T2320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1025804 T2368 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> C126_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:47424_wzl, base_url=http://127.0.0.1:47424/wzl}
[junit4:junit4] 2> 1026377 T2397 C126 P47424 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:15872/wzl/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1026377 T2397 C126 P47424 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:47424/wzl START replicas=[http://127.0.0.1:15872/wzl/collection1/] nUpdates=100
[junit4:junit4] 2> 1026378 T2397 C126 P47424 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1026379 T2397 C126 P47424 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1026379 T2397 C126 P47424 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1026379 T2397 C126 P47424 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1026380 T2397 C126 P47424 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1026380 T2397 C126 P47424 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:15872/wzl/collection1/. core=collection1
[junit4:junit4] 2> 1026380 T2397 C126 P47424 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C128 name=collection1 org.apache.solr.core.SolrCore@131a388 url=http://127.0.0.1:15872/wzl/collection1 node=127.0.0.1:15872_wzl C128_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:15872_wzl, base_url=http://127.0.0.1:15872/wzl, leader=true}
[junit4:junit4] 2> 1026407 T2353 C128 P15872 oasc.SolrCore.execute [collection1] webapp=/wzl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1026413 T2354 C128 P15872 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1026416 T2354 C128 P15872 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c4dcbaf lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb9fd94),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1026416 T2354 C128 P15872 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1026417 T2354 C128 P15872 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c4dcbaf lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb9fd94),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c4dcbaf lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb9fd94),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1026418 T2354 C128 P15872 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1026418 T2354 C128 P15872 oass.SolrIndexSearcher.<init> Opening Searcher@51ab09f9 realtime
[junit4:junit4] 2> 1026419 T2354 C128 P15872 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1026419 T2354 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1026420 T2397 C126 P47424 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1026421 T2397 C126 P47424 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1026423 T2355 C128 P15872 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1026423 T2355 C128 P15872 oasc.SolrCore.execute [collection1] webapp=/wzl path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1026424 T2397 C126 P47424 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1026424 T2397 C126 P47424 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1026425 T2397 C126 P47424 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1026427 T2355 C128 P15872 oasc.SolrCore.execute [collection1] webapp=/wzl path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1026428 T2397 C126 P47424 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1026429 T2397 C126 P47424 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3/index.20130516022700378
[junit4:junit4] 2> 1026430 T2397 C126 P47424 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6d66bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@65282101) fullCopy=false
[junit4:junit4] 2> 1026432 T2355 C128 P15872 oasc.SolrCore.execute [collection1] webapp=/wzl path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1026433 T2397 C126 P47424 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1026434 T2397 C126 P47424 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1026435 T2397 C126 P47424 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1026437 T2397 C126 P47424 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7e11f696 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53632e03),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7e11f696 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53632e03),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1026437 T2397 C126 P47424 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1026438 T2397 C126 P47424 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1026438 T2397 C126 P47424 oass.SolrIndexSearcher.<init> Opening Searcher@39a35abe main
[junit4:junit4] 2> 1026439 T2396 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@39a35abe main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1026440 T2397 C126 P47424 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3/index.20130516022700378 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3/index.20130516022700378;done=true>>]
[junit4:junit4] 2> 1026440 T2397 C126 P47424 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3/index.20130516022700378
[junit4:junit4] 2> 1026440 T2397 C126 P47424 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty3/index.20130516022700378
[junit4:junit4] 2> 1026441 T2397 C126 P47424 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1026441 T2397 C126 P47424 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1026441 T2397 C126 P47424 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1026441 T2397 C126 P47424 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1026468 T2397 C126 P47424 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1026583 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1026585 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46695_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46695/wzl"}
[junit4:junit4] 2> 1026589 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47424_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47424/wzl"}
[junit4:junit4] 2> 1026609 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1026609 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1026609 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1026609 T2394 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1026609 T2411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1026609 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1026798 T2320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1026806 T2368 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1026806 T2368 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:46695_wzl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 1027801 T2320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1028804 T2320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C127_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:46695_wzl, base_url=http://127.0.0.1:46695/wzl}
[junit4:junit4] 2> 1028808 T2414 C127 P46695 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:15875/wzl/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1028808 T2414 C127 P46695 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:46695/wzl START replicas=[http://127.0.0.1:15875/wzl/collection1/] nUpdates=100
[junit4:junit4] 2> 1028809 T2414 C127 P46695 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1028809 T2414 C127 P46695 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1028809 T2414 C127 P46695 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1028809 T2414 C127 P46695 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1028810 T2414 C127 P46695 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1028810 T2414 C127 P46695 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:15875/wzl/collection1/. core=collection1
[junit4:junit4] 2> 1028811 T2414 C127 P46695 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C129 name=collection1 org.apache.solr.core.SolrCore@f9e1116 url=http://127.0.0.1:15875/wzl/collection1 node=127.0.0.1:15875_wzl C129_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:15875_wzl, base_url=http://127.0.0.1:15875/wzl, leader=true}
[junit4:junit4] 2> 1028817 T2369 C129 P15875 oasc.SolrCore.execute [collection1] webapp=/wzl path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1028822 T2370 C129 P15875 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1028825 T2370 C129 P15875 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b6df51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53e07963),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1028825 T2370 C129 P15875 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1028826 T2370 C129 P15875 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b6df51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53e07963),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b6df51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53e07963),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1028827 T2370 C129 P15875 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1028827 T2370 C129 P15875 oass.SolrIndexSearcher.<init> Opening Searcher@39dc83c4 realtime
[junit4:junit4] 2> 1028828 T2370 C129 P15875 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1028828 T2370 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1028829 T2414 C127 P46695 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1028830 T2414 C127 P46695 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1028831 T2371 C129 P15875 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1028832 T2371 C129 P15875 oasc.SolrCore.execute [collection1] webapp=/wzl path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1028832 T2414 C127 P46695 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1028833 T2414 C127 P46695 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1028833 T2414 C127 P46695 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1028835 T2371 C129 P15875 oasc.SolrCore.execute [collection1] webapp=/wzl path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1028836 T2414 C127 P46695 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1028837 T2414 C127 P46695 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4/index.20130516022702786
[junit4:junit4] 2> 1028837 T2414 C127 P46695 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@50b2bebc lockFactory=org.apache.lucene.store.NativeFSLockFactory@1507d8ef) fullCopy=false
[junit4:junit4] 2> 1028860 T2371 C129 P15875 oasc.SolrCore.execute [collection1] webapp=/wzl path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1028862 T2414 C127 P46695 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1028862 T2414 C127 P46695 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1028863 T2414 C127 P46695 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1028864 T2414 C127 P46695 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73307b82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@180bb0b1),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73307b82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@180bb0b1),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1028864 T2414 C127 P46695 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1028865 T2414 C127 P46695 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1028865 T2414 C127 P46695 oass.SolrIndexSearcher.<init> Opening Searcher@7374be2f main
[junit4:junit4] 2> 1028866 T2413 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7374be2f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1028866 T2414 C127 P46695 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4/index.20130516022702786 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4/index.20130516022702786;done=true>>]
[junit4:junit4] 2> 1028866 T2414 C127 P46695 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4/index.20130516022702786
[junit4:junit4] 2> 1028867 T2414 C127 P46695 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368660399771/jetty4/index.20130516022702786
[junit4:junit4] 2> 1028867 T2414 C127 P46695 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1028867 T2414 C127 P46695 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1028867 T2414 C127 P46695 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1028867 T2414 C127 P46695 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1028869 T2414 C127 P46695 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1029618 T2343 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1029619 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46695_wzl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46695/wzl"}
[junit4:junit4] 2> 1029636 T2378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1029636 T2394 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1029636 T2362 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1029636 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1029636 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1029636 T2411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1029806 T2320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1029808 T2320 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C130 name=collection1 org.apache.solr.core.SolrCore@57fe7b3b url=http://127.0.0.1:15867/wzl/collection1 node=127.0.0.1:15867_wzl C130_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:15867_wzl, base_url=http://127.0.0.1:15867/wzl, leader=true}
[junit4:junit4] 2> 1029814 T2332 C130 P15867 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1029817 T2332 C130 P15867 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5e66e561 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47013dd8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1029818 T2332 C130 P15867 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1029819 T2332 C130 P15867 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5e66e561 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47013dd8),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5e66e561 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47013dd8),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1029819 T2332 C130 P15867 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1029819 T2332 C130 P15867 oass.SolrIndexSearcher.<init> Opening Searcher@26545e52 main
[junit4:junit4] 2> 1029820 T2332 C130 P15867 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1029821 T2346 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@26545e52 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1029821 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1029832 T2356 C128 P15872 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1029834 T2356 C128 P15872 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c4dcbaf lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb9fd94),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c4dcbaf lockFactory=org.apache.lucene.store.NativeFSLockFactory@1eb9fd94),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1029835 T2356 C128 P15872 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1029836 T2356 C128 P15872 oass.SolrIndexSearcher.<init> Opening Searcher@33453f27 main
[junit4:junit4] 2> 1029837 T2356 C128 P15872 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1029837 T2364 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33453f27 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1029838 T2356 C128 P15872 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:47424/wzl/collection1/, StdNode: http://127.0.0.1:15875/wzl/collection1/, StdNode: http://127.0.0.1:46695/wzl/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1029841 T2372 C129 P15875 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1029842 T2372 C129 P15875 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b6df51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53e07963),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b6df51 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53e07963),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1029843 T2372 C129 P15875 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1029843 T2372 C129 P15875 oass.SolrIndexSearcher.<init> Opening Searcher@36000f8f main
[junit4:junit4] 2> 1029844 T2372 C129 P15875 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1029844 T2380 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@36000f8f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1029845 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> C126_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:47424_wzl, base_url=http://127.0.0.1:47424/wzl}
[junit4:junit4] 2> 1029849 T2384 C126 P47424 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1029850 T2384 C126 P47424 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7e11f696 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53632e03),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7e11f696 lockFactory=org.apache.lucene.store.NativeFSLockFactory@53632e03),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1029851 T2384 C126 P47424 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1029852 T2384 C126 P47424 oass.SolrIndexSearcher.<init> Opening Searcher@2e2f21a9 main
[junit4:junit4] 2> 1029853 T2384 C126 P47424 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> C127_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46695_wzl, base_url=http://127.0.0.1:46695/wzl}
[junit4:junit4] 2> 1029853 T2401 C127 P46695 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1029854 T2396 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2e2f21a9 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1029855 T2401 C127 P46695 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73307b82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@180bb0b1),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73307b82 lockFactory=org.apache.lucene.store.NativeFSLockFactory@180bb0b1),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1029855 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1029856 T2401 C127 P46695 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1029857 T2401 C127 P46695 oass.SolrIndexSearcher.<init> Opening Searcher@78efe8b main
[junit4:junit4] 2> 1029858 T2401 C127 P46695 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1029859 T2413 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@78efe8b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1029859 T2401 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1029860 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 28
[junit4:junit4] 2> 1029861 T2320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1029864 T2357 C128 P15872 oasc.SolrCore.execute [collection1] webapp=/wzl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1029866 T2385 C126 P47424 oasc.SolrCore.execute [collection1] webapp=/wzl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1029868 T2373 C129 P15875 oasc.SolrCore.execute [collection1] webapp=/wzl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1029869 T2402 C127 P46695 oasc.SolrCore.execute [collection1] webapp=/wzl path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1031875 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435144474667778048)} 0 3
[junit4:junit4] 2> 1031884 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={update.distrib=FROMLEADER&_version_=-1435144474674069504&update.from=http://127.0.0.1:15872/wzl/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435144474674069504)} 0 1
[junit4:junit4] 2> 1031886 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={update.distrib=FROMLEADER&_version_=-1435144474677215232&update.from=http://127.0.0.1:15875/wzl/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435144474677215232)} 0 1
[junit4:junit4] 2> 1031886 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435144474677215232)} 0 4
[junit4:junit4] 2> 1031887 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435144474674069504)} 0 8
[junit4:junit4] 2> 1031891 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[a!0 (1435144474685603840)]} 0 1
[junit4:junit4] 2> 1031899 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435144474691895296)]} 0 0
[junit4:junit4] 2> 1031900 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1435144474691895296)]} 0 4
[junit4:junit4] 2> 1031900 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[a!0]} 0 6
[junit4:junit4] 2> 1031904 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[b!1 (1435144474699235328)]} 0 1
[junit4:junit4] 2> 1031909 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435144474703429632)]} 0 0
[junit4:junit4] 2> 1031910 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[b!1 (1435144474703429632)]} 0 3
[junit4:junit4] 2> 1031913 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[c!2 (1435144474708672512)]} 0 1
[junit4:junit4] 2> 1031918 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435144474712866816)]} 0 0
[junit4:junit4] 2> 1031919 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[c!2 (1435144474712866816)]} 0 3
[junit4:junit4] 2> 1031922 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[d!3 (1435144474718109696)]} 0 1
[junit4:junit4] 2> 1031926 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435144474721255424)]} 0 0
[junit4:junit4] 2> 1031927 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[d!3 (1435144474721255424)]} 0 3
[junit4:junit4] 2> 1031930 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[e!4 (1435144474726498304)]} 0 1
[junit4:junit4] 2> 1031938 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435144474732789760)]} 0 0
[junit4:junit4] 2> 1031939 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1435144474732789760)]} 0 4
[junit4:junit4] 2> 1031939 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[e!4]} 0 6
[junit4:junit4] 2> 1031943 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[f!5 (1435144474740129792)]} 0 1
[junit4:junit4] 2> 1031950 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435144474746421248)]} 0 0
[junit4:junit4] 2> 1031951 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1435144474746421248)]} 0 3
[junit4:junit4] 2> 1031951 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[f!5]} 0 5
[junit4:junit4] 2> 1031955 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[g!6 (1435144474753761280)]} 0 1
[junit4:junit4] 2> 1031960 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435144474756907008)]} 0 0
[junit4:junit4] 2> 1031961 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[g!6 (1435144474756907008)]} 0 3
[junit4:junit4] 2> 1031964 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[h!7 (1435144474762149888)]} 0 1
[junit4:junit4] 2> 1031971 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435144474767392768)]} 0 0
[junit4:junit4] 2> 1031972 T2358 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1435144474767392768)]} 0 4
[junit4:junit4] 2> 1031972 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[h!7]} 0 5
[junit4:junit4] 2> 1031976 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[i!8 (1435144474774732800)]} 0 1
[junit4:junit4] 2> 1031983 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435144474781024256)]} 0 0
[junit4:junit4] 2> 1031984 T2358 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!8 (1435144474781024256)]} 0 3
[junit4:junit4] 2> 1031984 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[i!8]} 0 5
[junit4:junit4] 2> 1031987 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[j!9 (1435144474786267136)]} 0 1
[junit4:junit4] 2> 1031994 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435144474792558592)]} 0 0
[junit4:junit4] 2> 1031995 T2358 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!9 (1435144474792558592)]} 0 3
[junit4:junit4] 2> 1031995 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[j!9]} 0 5
[junit4:junit4] 2> 1031999 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[k!10 (1435144474798850048)]} 0 1
[junit4:junit4] 2> 1032004 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435144474803044352)]} 0 0
[junit4:junit4] 2> 1032005 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[k!10 (1435144474803044352)]} 0 3
[junit4:junit4] 2> 1032008 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[l!11 (1435144474808287232)]} 0 1
[junit4:junit4] 2> 1032014 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435144474813530112)]} 0 0
[junit4:junit4] 2> 1032015 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1435144474813530112)]} 0 3
[junit4:junit4] 2> 1032015 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[l!11]} 0 5
[junit4:junit4] 2> 1032019 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[m!12 (1435144474819821568)]} 0 1
[junit4:junit4] 2> 1032025 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435144474825064448)]} 0 0
[junit4:junit4] 2> 1032026 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1435144474825064448)]} 0 3
[junit4:junit4] 2> 1032026 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[m!12]} 0 5
[junit4:junit4] 2> 1032030 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[n!13 (1435144474831355904)]} 0 1
[junit4:junit4] 2> 1032037 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435144474837647360)]} 0 0
[junit4:junit4] 2> 1032038 T2358 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1435144474837647360)]} 0 3
[junit4:junit4] 2> 1032038 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[n!13]} 0 5
[junit4:junit4] 2> 1032042 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[o!14 (1435144474843938816)]} 0 1
[junit4:junit4] 2> 1032050 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435144474850230272)]} 0 1
[junit4:junit4] 2> 1032050 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!14 (1435144474850230272)]} 0 3
[junit4:junit4] 2> 1032051 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[o!14]} 0 6
[junit4:junit4] 2> 1032055 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[p!15 (1435144474857570304)]} 0 1
[junit4:junit4] 2> 1032062 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435144474861764608)]} 0 1
[junit4:junit4] 2> 1032062 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[p!15 (1435144474861764608)]} 0 4
[junit4:junit4] 2> 1032066 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[q!16 (1435144474869104640)]} 0 1
[junit4:junit4] 2> 1032072 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435144474873298944)]} 0 0
[junit4:junit4] 2> 1032073 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[q!16 (1435144474873298944)]} 0 4
[junit4:junit4] 2> 1032077 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[r!17 (1435144474880638976)]} 0 1
[junit4:junit4] 2> 1032084 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435144474886930432)]} 0 0
[junit4:junit4] 2> 1032085 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!17 (1435144474886930432)]} 0 3
[junit4:junit4] 2> 1032085 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[r!17]} 0 5
[junit4:junit4] 2> 1032089 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[s!18 (1435144474893221888)]} 0 1
[junit4:junit4] 2> 1032096 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435144474899513344)]} 0 0
[junit4:junit4] 2> 1032097 T2358 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1435144474899513344)]} 0 3
[junit4:junit4] 2> 1032097 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[s!18]} 0 5
[junit4:junit4] 2> 1032101 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[t!19 (1435144474905804800)]} 0 1
[junit4:junit4] 2> 1032106 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435144474909999104)]} 0 0
[junit4:junit4] 2> 1032107 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[t!19 (1435144474909999104)]} 0 3
[junit4:junit4] 2> 1032110 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[u!20 (1435144474915241984)]} 0 1
[junit4:junit4] 2> 1032117 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435144474921533440)]} 0 0
[junit4:junit4] 2> 1032118 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1435144474921533440)]} 0 3
[junit4:junit4] 2> 1032118 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[u!20]} 0 5
[junit4:junit4] 2> 1032122 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[v!21 (1435144474927824896)]} 0 1
[junit4:junit4] 2> 1032129 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435144474934116352)]} 0 0
[junit4:junit4] 2> 1032130 T2358 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!21 (1435144474934116352)]} 0 3
[junit4:junit4] 2> 1032131 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[v!21]} 0 6
[junit4:junit4] 2> 1032134 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[w!22 (1435144474940407808)]} 0 1
[junit4:junit4] 2> 1032138 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435144474943553536)]} 0 0
[junit4:junit4] 2> 1032139 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[w!22 (1435144474943553536)]} 0 3
[junit4:junit4] 2> 1032143 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[x!23 (1435144474949844992)]} 0 1
[junit4:junit4] 2> 1032149 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435144474955087872)]} 0 0
[junit4:junit4] 2> 1032150 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1435144474955087872)]} 0 3
[junit4:junit4] 2> 1032150 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[x!23]} 0 5
[junit4:junit4] 2> 1032154 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[y!24 (1435144474961379328)]} 0 1
[junit4:junit4] 2> 1032161 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435144474967670784)]} 0 0
[junit4:junit4] 2> 1032162 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1435144474967670784)]} 0 3
[junit4:junit4] 2> 1032162 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[y!24]} 0 5
[junit4:junit4] 2> 1032166 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[z!25 (1435144474973962240)]} 0 1
[junit4:junit4] 2> 1032171 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435144474978156544)]} 0 0
[junit4:junit4] 2> 1032172 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[z!25 (1435144474978156544)]} 0 3
[junit4:junit4] 2> 1032175 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[a!26 (1435144474984448000)]} 0 0
[junit4:junit4] 2> 1032182 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435144474989690880)]} 0 0
[junit4:junit4] 2> 1032183 T2372 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!26 (1435144474989690880)]} 0 3
[junit4:junit4] 2> 1032183 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[a!26]} 0 5
[junit4:junit4] 2> 1032187 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[b!27 (1435144474995982336)]} 0 1
[junit4:junit4] 2> 1032193 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435144475001225216)]} 0 0
[junit4:junit4] 2> 1032194 T2358 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1435144475001225216)]} 0 3
[junit4:junit4] 2> 1032195 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[b!27]} 0 6
[junit4:junit4] 2> 1032197 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[c!28 (1435144475007516672)]} 0 0
[junit4:junit4] 2> 1032204 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435144475012759552)]} 0 0
[junit4:junit4] 2> 1032205 T2358 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1435144475012759552)]} 0 3
[junit4:junit4] 2> 1032206 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[c!28]} 0 6
[junit4:junit4] 2> 1032209 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[d!29 (1435144475019051008)]} 0 1
[junit4:junit4] 2> 1032213 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435144475022196736)]} 0 0
[junit4:junit4] 2> 1032214 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[d!29 (1435144475022196736)]} 0 3
[junit4:junit4] 2> 1032218 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[e!30 (1435144475028488192)]} 0 1
[junit4:junit4] 2> 1032222 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435144475031633920)]} 0 0
[junit4:junit4] 2> 1032223 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[e!30 (1435144475031633920)]} 0 3
[junit4:junit4] 2> 1032227 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[f!31 (1435144475037925376)]} 0 1
[junit4:junit4] 2> 1032231 T2403 C127 P46695 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435144475041071104)]} 0 0
[junit4:junit4] 2> 1032232 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[f!31 (1435144475041071104)]} 0 3
[junit4:junit4] 2> 1032235 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[g!32 (1435144475047362560)]} 0 0
[junit4:junit4] 2> 1032240 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435144475050508288)]} 0 0
[junit4:junit4] 2> 1032241 T2356 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[g!32 (1435144475050508288)]} 0 3
[junit4:junit4] 2> 1032244 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[h!33 (1435144475056799744)]} 0 0
[junit4:junit4] 2> 1032252 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435144475062042624)]} 0 0
[junit4:junit4] 2> 1032253 T2358 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1435144475062042624)]} 0 4
[junit4:junit4] 2> 1032254 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[h!33]} 0 7
[junit4:junit4] 2> 1032258 T2332 C130 P15867 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={wt=javabin&version=2} {add=[i!34 (1435144475070431232)]} 0 1
[junit4:junit4] 2> 1032265 T2384 C126 P47424 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15872/wzl/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435144475076722688)]} 0 0
[junit4:junit4] 2> 1032266 T2358 C128 P15872 oasup.LogUpdateProcessor.finish [collection1] webapp=/wzl path=/update params={distrib.from=http://127.0.0.1:15875/wzl/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1435144475076722688)]} 0 3
[junit4:junit4] 2> 1032267 T2374 C129 P15875 oasup.LogUpdateProcessor.finish [collec
[...truncated too long message...]
rector.execute(DefaultRequestDirector.java:480)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4:junit4] 2> ... 5 more
[junit4:junit4] 2>
[junit4:junit4] 2> 1355871 T2469 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89696527959851020-127.0.0.1:46695_wzl-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 1355873 T2411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1355873 T2411 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1355874 T2452 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4] 2> 1355874 T2411 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1355873 T2320 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/wzl,null}
[junit4:junit4] 2> 1355874 T2452 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4:junit4] 2> 1355945 T2320 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1355947 T2320 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:15864 15864
[junit4:junit4] 2> 1357148 T2452 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45fa97b0 name:ZooKeeperConnection Watcher:127.0.0.1:15864/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4] 2> 1357148 T2452 oascc.ConnectionManager.process Client->ZooKeeper status change trigger but we are already closed
[junit4:junit4] 2> 1357158 T2320 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 15867
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-1368660399771 FAILED !!!!!
[junit4:junit4] 2> 1357159 T2320 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1357159 T2320 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:15864 15864
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1_1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1_shard1_1_replica1",
[junit4:junit4] 1> "node_name":"127.0.0.1:15872_wzl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:15872/wzl"}
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:15875_wzl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:15875/wzl"}
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89696527959851011-1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:15867_wzl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:15867/wzl"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (5)
[junit4:junit4] 1> /solr/overseer_elect/election/89696527959851014-127.0.0.1:15872_wzl-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89696527959851011-127.0.0.1:15867_wzl-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89696527959851016-127.0.0.1:15875_wzl-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89696527959851020-127.0.0.1:46695_wzl-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89696527959851018-127.0.0.1:47424_wzl-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89696527959851011-127.0.0.1:15867_wzl-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=30F79478D1F21737 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=it_IT -Dtests.timezone=Europe/Helsinki -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 351s J1 | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Wrong doc count on shard1_1 expected:<487> but was:<486>
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([30F79478D1F21737:B1111A60A6AD770B]:0)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.checkDocCountsAndShardStates(ShardSplitTest.java:167)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:142)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1357190 T2320 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 351379 T2319 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=it_IT, timezone=Europe/Helsinki
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=1,free=152947688,total=501219328
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestJmxMonitoredMap, TestZkChroot, DocumentAnalysisRequestHandlerTest, TestSolrJ, ScriptEngineTest, TestFastOutputStream, WordBreakSolrSpellCheckerTest, SliceStateTest, TestFiltering, TestTrie, TestPHPSerializedResponseWriter, TestSolrDeletionPolicy1, TestUtils, DirectUpdateHandlerOptimizeTest, MinimalSchemaTest, CircularListTest, ResponseLogComponentTest, ChaosMonkeySafeLeaderTest, EchoParamsTest, ClusterStateUpdateTest, PathHierarchyTokenizerFactoryTest, DebugComponentTest, SpellCheckComponentTest, DisMaxRequestHandlerTest, TestLuceneMatchVersion, PrimUtilsTest, CurrencyFieldOpenExchangeTest, TestSolrQueryParserResource, TestFastLRUCache, TestSweetSpotSimilarityFactory, ShowFileRequestHandlerTest, TestPartialUpdateDeduplication, SimpleFacetsTest, TestCoreContainer, BasicDistributedZkTest, TestLMDirichletSimilarityFactory, TestStressLucene, OverseerCollectionProcessorTest, UUIDFieldTest, DocValuesTest, TestCollationKeyRangeQueries, TestLFUCache, TestPropInject, TestPerFieldSimilarity, TestSuggestSpellingConverter, SuggesterTSTTest, TestSurroundQueryParser, ShardRoutingTest, RegexBoostProcessorTest, SampleTest, TestPluginEnable, TestShardHandlerFactory, CSVRequestHandlerTest, TestDynamicFieldCollectionResource, ReturnFieldsTest, SignatureUpdateProcessorFactoryTest, TestCloudManagedSchemaAddField, IndexSchemaTest, SortByFunctionTest, TestRemoteStreaming, BinaryUpdateRequestHandlerTest, DistanceFunctionTest, TestBinaryResponseWriter, TestManagedSchema, TermVectorComponentDistributedTest, TestFastWriter, PingRequestHandlerTest, TestSolrQueryParserDefaultOperatorResource, TestValueSourceCache, CachingDirectoryFactoryTest, HighlighterConfigTest, ExternalFileFieldSortTest, ChaosMonkeyShardSplitTest, ShardSplitTest]
[junit4:junit4] Completed on J1 in 351.67s, 1 test, 1 failure <<< FAILURES!
[...truncated 465 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 suite-level error, 1 failure, 27 ignored (8 assumptions)
Total time: 54 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1249 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1249/
2 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:50835 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:50835 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([A1738093571D44B1:20950E8B2042248D]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:48719 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:48719 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([A1738093571D44B1:20950E8B2042248D]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9618 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.293; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.298; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1368649033299
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.299; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.300; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.401; org.apache.solr.cloud.ZkTestServer; start zk server on port:55485
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.402; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.435; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4ba225f3 name:ZooKeeperConnection Watcher:127.0.0.1:55485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.435; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.435; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.448; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.450; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@3eede6ba name:ZooKeeperConnection Watcher:127.0.0.1:55485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.451; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.451; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.459; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.461; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.469; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.472; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.473; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.484; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.485; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.589; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.590; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.599; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.599; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.602; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.603; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.606; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.607; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.610; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.611; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.614; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.614; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.618; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.618; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.790; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.794; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:55488
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.794; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.795; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.795; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368649033628
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.796; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368649033628/solr.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.796; org.apache.solr.core.CoreContainer; New CoreContainer 1532497588
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.797; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368649033628/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.797; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368649033628/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.885; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.886; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.886; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.887; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.887; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.887; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.888; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.888; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.889; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.889; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.902; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.902; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:55485/solr
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.903; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.904; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.907; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7a9166e7 name:ZooKeeperConnection Watcher:127.0.0.1:55485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.907; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.910; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.919; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.921; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5856c8bb name:ZooKeeperConnection Watcher:127.0.0.1:55485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.921; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.924; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.933; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.937; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.944; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55488_
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.945; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:55488_
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.949; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.965; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.968; org.apache.solr.cloud.Overseer; Overseer (id=89695783046676483-127.0.0.1:55488_-n_0000000000) starting
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.978; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.988; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.988; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.996; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4] 2> INFO - 2013-05-15 20:17:13.998; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.000; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.004; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368649033628/collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.004; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.005; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.005; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.006; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368649033628/collection1/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.008; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368649033628/collection1/lib/README' to classloader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.008; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368649033628/collection1/lib/classes/' to classloader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.048; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.094; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.196; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.202; org.apache.solr.schema.IndexSchema; [collection1] Schema name=test
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.792; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.797; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.799; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.805; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.830; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.830; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368649033628/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/control/data/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.831; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7eda2096
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.831; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.832; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/control/data
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.832; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/control/data/index/
[junit4:junit4] 2> WARN - 2013-05-15 20:17:14.833; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.833; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/control/data/index
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.837; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2896b1c2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17844905),segFN=segments_1,generation=1}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.838; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.841; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.841; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.842; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.843; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.843; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.844; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.844; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.845; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.845; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.858; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.873; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@76752f31 main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.873; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/control/data/tlog
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.874; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.875; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.878; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@76752f31 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.880; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 2> INFO - 2013-05-15 20:17:14.881; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.504; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.505; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55488"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.506; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.506; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.521; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.883; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.883; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:55488 collection:control_collection shard:shard1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.884; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.902; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.912; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.913; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.913; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:55488/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.914; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.914; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:55488/collection1/ has no replicas
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.914; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:55488/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:15.915; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.026; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.043; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.103; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:55488/collection1/ and leader is http://127.0.0.1:55488/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.103; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55488
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.103; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.104; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.104; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.106; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.107; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.108; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.109; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.130; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.132; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.172; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@56a36e2f name:ZooKeeperConnection Watcher:127.0.0.1:55485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.173; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.175; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.178; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.396; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.399; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:50835
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.400; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.401; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.401; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368649037179
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.402; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368649037179/solr.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.402; org.apache.solr.core.CoreContainer; New CoreContainer 1744271165
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.403; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368649037179/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.404; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368649037179/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.522; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.523; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.524; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.524; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.525; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.525; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.526; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.527; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.527; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.528; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.545; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.546; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:55485/solr
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.546; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.548; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.551; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4f07735d name:ZooKeeperConnection Watcher:127.0.0.1:55485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.552; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.563; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.577; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.580; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@672f943d name:ZooKeeperConnection Watcher:127.0.0.1:55485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.580; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:17.586; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.558; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.558; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:55488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55488"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.574; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.574; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.574; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.590; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50835_
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.592; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:50835_
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.595; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.596; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.596; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.596; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.597; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.597; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.608; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368649037179/collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.608; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.609; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.609; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.611; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368649037179/collection1/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.612; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368649037179/collection1/lib/classes/' to classloader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.613; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368649037179/collection1/lib/README' to classloader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.665; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.727; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.829; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:18.834; org.apache.solr.schema.IndexSchema; [collection1] Schema name=test
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.423; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.427; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.430; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.435; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.460; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.461; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368649037179/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.461; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7eda2096
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.462; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.462; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.463; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty1/index/
[junit4:junit4] 2> WARN - 2013-05-15 20:17:19.463; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.465; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty1/index
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.468; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5978300e lockFactory=org.apache.lucene.store.NativeFSLockFactory@74c6aa8e),segFN=segments_1,generation=1}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.468; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.471; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.472; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.473; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.473; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.474; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.474; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.475; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.476; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.476; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.489; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.495; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3ee2ba2f main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.496; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty1/tlog
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.497; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.497; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.502; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@3ee2ba2f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.505; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 2> INFO - 2013-05-15 20:17:19.505; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.081; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.082; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50835_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50835"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.083; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.083; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.091; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.091; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.091; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.510; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.510; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:50835 collection:collection1 shard:shard1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.511; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.522; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.531; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.532; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.532; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:50835/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.532; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.533; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:50835/collection1/ has no replicas
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.533; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:50835/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:20.534; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.596; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.614; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.614; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.614; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.619; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:50835/collection1/ and leader is http://127.0.0.1:50835/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.619; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50835
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.619; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.620; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.620; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.622; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.623; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.624; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.624; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.854; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.859; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:11334
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.859; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.860; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.861; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368649041640
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.861; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368649041640/solr.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.862; org.apache.solr.core.CoreContainer; New CoreContainer 1547422450
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.863; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368649041640/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.863; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368649041640/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:21.999; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.000; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.001; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.001; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.002; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.002; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.003; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.004; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.004; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.005; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.020; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.021; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:55485/solr
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.022; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.023; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.026; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1f88fe6c name:ZooKeeperConnection Watcher:127.0.0.1:55485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.027; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.041; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.052; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.054; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@3ed80826 name:ZooKeeperConnection Watcher:127.0.0.1:55485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.055; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:22.060; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.064; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11334_
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.092; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:11334_
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.096; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.096; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.096; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.096; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.096; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.097; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.098; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.104; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368649041640/collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.105; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.105; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.106; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.107; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368649041640/collection1/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.109; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368649041640/collection1/lib/classes/' to classloader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.109; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368649041640/collection1/lib/README' to classloader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.120; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.121; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50835_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50835"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.133; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.133; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.133; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.133; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.166; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.228; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.330; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.335; org.apache.solr.schema.IndexSchema; [collection1] Schema name=test
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.922; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.927; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.929; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.935; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.959; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.959; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368649041640/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty2/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.960; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7eda2096
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.960; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.961; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.962; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty2/index/
[junit4:junit4] 2> WARN - 2013-05-15 20:17:23.962; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.963; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty2/index
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.966; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@36b76a9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d659c02),segFN=segments_1,generation=1}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.966; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.969; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.970; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.971; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.972; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.972; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.973; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.973; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.974; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.974; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.987; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.994; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@58e25354 main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.994; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty2/tlog
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.995; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 2> INFO - 2013-05-15 20:17:23.995; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.000; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@58e25354 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.002; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.003; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.640; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.640; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11334_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11334"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.641; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.641; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.655; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.656; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.655; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:24.656; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.006; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.006; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:11334 collection:collection1 shard:shard2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.007; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.024; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.027; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.028; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.028; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:11334/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.028; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.029; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:11334/collection1/ has no replicas
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.029; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:11334/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:25.029; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.160; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.179; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.179; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.179; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.179; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.208; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:11334/collection1/ and leader is http://127.0.0.1:11334/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.208; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:11334
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.208; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.209; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.209; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.211; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.212; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.213; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.213; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.458; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.462; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:52370
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.463; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.463; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.464; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368649046229
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.465; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368649046229/solr.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.465; org.apache.solr.core.CoreContainer; New CoreContainer 875889108
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.466; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368649046229/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.467; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368649046229/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.585; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.586; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.587; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.588; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.588; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.589; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.589; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.590; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.591; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.591; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.609; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.609; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:55485/solr
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.610; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.611; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.614; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@357a6f7b name:ZooKeeperConnection Watcher:127.0.0.1:55485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.615; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.629; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.642; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.644; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@132ebad9 name:ZooKeeperConnection Watcher:127.0.0.1:55485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.645; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:26.656; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.660; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52370_
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.663; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:52370_
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.666; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.667; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.668; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.668; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.667; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.667; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.669; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.669; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.669; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.683; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368649046229/collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.684; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.684; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.685; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.685; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.686; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:11334_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:11334"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.687; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368649046229/collection1/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.688; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368649046229/collection1/lib/classes/' to classloader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.689; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368649046229/collection1/lib/README' to classloader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.706; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.743; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.806; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.908; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:27.914; org.apache.solr.schema.IndexSchema; [collection1] Schema name=test
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.501; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.505; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.508; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.513; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.540; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.540; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368649046229/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.541; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7eda2096
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.541; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.542; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.542; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3/index/
[junit4:junit4] 2> WARN - 2013-05-15 20:17:28.543; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.544; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3/index
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.547; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a728b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bcb22ac),segFN=segments_1,generation=1}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.548; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.551; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.551; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.552; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.553; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.554; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.554; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.555; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.555; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.556; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.569; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.575; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@547fbb0e main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.576; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3/tlog
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.577; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.577; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.582; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@547fbb0e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.585; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 2> INFO - 2013-05-15 20:17:28.585; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.211; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.212; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52370_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52370"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.213; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.213; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.252; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.253; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.253; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.253; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.253; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.588; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.588; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:52370 collection:collection1 shard:shard1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.592; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:52370/collection1/ and leader is http://127.0.0.1:50835/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.592; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52370
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.592; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.593; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.593; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.595; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.595; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.595; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.595; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.597; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.597; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.597; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.598; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.616; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.839; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.843; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:24715
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.843; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.844; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.845; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368649049615
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.845; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368649049615/solr.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.846; org.apache.solr.core.CoreContainer; New CoreContainer 2041474846
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.847; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368649049615/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.847; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368649049615/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.966; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.967; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.968; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.968; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.969; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.969; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.970; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.971; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.971; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.972; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.987; org.apache.solr.logging.LogWatcher; Registering Log Listener
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.988; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:55485/solr
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.988; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.990; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.993; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@64c4f5c1 name:ZooKeeperConnection Watcher:127.0.0.1:55485 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.993; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:29.997; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.008; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.010; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@475a4720 name:ZooKeeperConnection Watcher:127.0.0.1:55485/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.010; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.022; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.757; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.758; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52370_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52370"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:30.776; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.026; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:24715_
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.028; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:24715_
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.031; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.031; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.032; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.031; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.031; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.033; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.031; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.032; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.032; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.034; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.033; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.034; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.040; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368649049615/collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.040; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.041; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.041; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.043; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368649049615/collection1/'
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.044; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368649049615/collection1/lib/README' to classloader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.045; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368649049615/collection1/lib/classes/' to classloader
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.098; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.179; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.281; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.286; org.apache.solr.schema.IndexSchema; [collection1] Schema name=test
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.619; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.619; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:52370_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.871; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.876; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.878; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.884; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.910; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.911; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368649049615/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.911; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7eda2096
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.912; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.913; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.913; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4/index/
[junit4:junit4] 2> WARN - 2013-05-15 20:17:31.913; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.914; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4/index
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.917; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ce4b916 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b3d7883),segFN=segments_1,generation=1}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.918; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.921; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.922; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.922; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.923; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.924; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.924; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.925; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.925; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.926; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.939; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.945; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@554f58e8 main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.946; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4/tlog
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.947; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.947; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.952; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@554f58e8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.954; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4] 2> INFO - 2013-05-15 20:17:31.955; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.283; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.284; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:24715_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:24715"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.284; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.284; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.330; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.331; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.331; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.330; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.330; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.330; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.958; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.958; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:24715 collection:collection1 shard:shard2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.965; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:24715/collection1/ and leader is http://127.0.0.1:11334/collection1/
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.965; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:24715
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.965; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.966; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.966; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.967; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.968; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.968; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.969; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.969; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.970; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.970; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.971; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.993; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.994; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.995; org.apache.solr.cloud.AbstractFullDistribZkTestBase; Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.995; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> INFO - 2013-05-15 20:17:32.996; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.622; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:50835/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.622; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:52370 START replicas=[http://127.0.0.1:50835/collection1/] nUpdates=100
[junit4:junit4] 2> WARN - 2013-05-15 20:17:33.623; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.624; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.624; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.624; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.625; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.625; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:50835/collection1/. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.625; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.632; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.639; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.642; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5978300e lockFactory=org.apache.lucene.store.NativeFSLockFactory@74c6aa8e),segFN=segments_1,generation=1}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.643; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.643; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5978300e lockFactory=org.apache.lucene.store.NativeFSLockFactory@74c6aa8e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5978300e lockFactory=org.apache.lucene.store.NativeFSLockFactory@74c6aa8e),segFN=segments_2,generation=2}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.644; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.645; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@19baf546 realtime
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.645; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.646; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.647; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.647; org.apache.solr.handler.SnapPuller; No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.649; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.649; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.650; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.651; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.651; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.653; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.654; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.655; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3/index.20130516011733654
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.655; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@595fa893 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bf5a67c) fullCopy=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.658; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.660; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.661; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.661; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.663; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a728b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bcb22ac),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a728b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bcb22ac),segFN=segments_2,generation=2}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.664; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.664; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.664; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@2a8ba685 main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.666; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@2a8ba685 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.666; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3/index.20130516011733654 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3/index.20130516011733654;done=true>>]
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.667; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3/index.20130516011733654
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.667; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty3/index.20130516011733654
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.667; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.667; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.668; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.668; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.670; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.864; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.865; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:24715_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:24715"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.869; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52370_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52370"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.883; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.884; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.884; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.884; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.883; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.883; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.996; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.996; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:24715_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> INFO - 2013-05-15 20:17:33.998; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:35.000; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:35.998; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:11334/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> INFO - 2013-05-15 20:17:35.998; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:24715 START replicas=[http://127.0.0.1:11334/collection1/] nUpdates=100
[junit4:junit4] 2> WARN - 2013-05-15 20:17:35.999; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4] 2> INFO - 2013-05-15 20:17:35.999; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:35.999; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.000; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.000; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.000; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:11334/collection1/. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.001; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.002; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.009; org.apache.solr.core.SolrCore; [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.013; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.016; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@36b76a9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d659c02),segFN=segments_1,generation=1}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.017; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.017; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@36b76a9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d659c02),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@36b76a9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d659c02),segFN=segments_2,generation=2}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.018; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.019; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@5c8294e9 realtime
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.019; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.020; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.021; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.021; org.apache.solr.handler.SnapPuller; No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.023; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for 10000
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.023; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.024; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.024; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.025; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.027; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.028; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.029; org.apache.solr.core.CachingDirectoryFactory; return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4/index.20130516011736028
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.029; org.apache.solr.handler.SnapPuller; Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fae05e9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@68565ef0) fullCopy=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.032; org.apache.solr.core.SolrCore; [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.034; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.035; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.036; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.037; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ce4b916 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b3d7883),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ce4b916 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b3d7883),segFN=segments_2,generation=2}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.038; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.038; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.039; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@5c271cb7 main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.040; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@5c271cb7 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.040; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4/index.20130516011736028 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4/index.20130516011736028;done=true>>]
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.041; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4/index.20130516011736028
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.041; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368649033299/jetty4/index.20130516011736028
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.041; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.042; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.042; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.042; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.044; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.898; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.899; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:24715_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:24715"}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:36.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.004; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.005; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: collection1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.015; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.019; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2896b1c2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17844905),segFN=segments_1,generation=1}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.020; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.021; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2896b1c2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17844905),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2896b1c2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17844905),segFN=segments_2,generation=2}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.021; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.022; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@4c7b7ec1 main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.022; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.023; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@4c7b7ec1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.024; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.037; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.038; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@36b76a9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d659c02),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@36b76a9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d659c02),segFN=segments_3,generation=3}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.038; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.039; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@2140f4b1 main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.040; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.040; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@2140f4b1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.041; org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode: http://127.0.0.1:50835/collection1/, StdNode: http://127.0.0.1:52370/collection1/, StdNode: http://127.0.0.1:24715/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.044; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.047; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5978300e lockFactory=org.apache.lucene.store.NativeFSLockFactory@74c6aa8e),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5978300e lockFactory=org.apache.lucene.store.NativeFSLockFactory@74c6aa8e),segFN=segments_3,generation=3}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.048; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.048; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@e4b893a main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.049; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.050; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@e4b893a main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.050; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.057; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.057; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.058; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a728b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bcb22ac),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a728b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bcb22ac),segFN=segments_3,generation=3}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.059; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ce4b916 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b3d7883),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ce4b916 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b3d7883),segFN=segments_3,generation=3}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.059; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.059; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.060; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@40cb5afe main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.061; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@a0a47c8 main
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.061; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.062; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@40cb5afe main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.062; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.063; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.063; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@a0a47c8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.064; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.065; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 29
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.066; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper...
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.070; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.072; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.074; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:37.076; org.apache.solr.core.SolrCore; [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.082; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435132555774918656)} 0 2
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.091; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435132555780161536&update.from=http://127.0.0.1:11334/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435132555780161536)} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.096; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435132555785404416&update.from=http://127.0.0.1:50835/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435132555785404416)} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.097; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435132555785404416)} 0 7
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.098; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435132555780161536)} 0 12
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.102; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1435132555795890176)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.112; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435132555803230208)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.113; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1435132555803230208)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.114; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0]} 0 9
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.118; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435132555812667392)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.124; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435132555815813120)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.124; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435132555815813120)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.128; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1435132555823153152)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.136; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435132555828396032)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.137; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1435132555828396032)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.137; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2]} 0 7
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.141; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435132555836784640)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.148; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435132555840978944)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.149; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435132555840978944)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.153; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435132555849367552)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.159; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435132555852513280)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.160; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435132555852513280)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.164; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1435132555860901888)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.172; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435132555866144768)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.173; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1435132555866144768)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.174; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.178; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1435132555875581952)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.185; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435132555879776256)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.186; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1435132555879776256)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.187; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6]} 0 7
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.190; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1435132555888164864)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.200; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435132555895504896)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.200; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1435132555895504896)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.201; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.205; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435132555903893504)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.212; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435132555908087808)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.213; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435132555908087808)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.217; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1435132555916476416)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.227; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435132555923816448)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.227; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1435132555923816448)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.228; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.232; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1435132555932205056)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.238; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435132555935350784)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.239; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1435132555935350784)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.243; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1435132555943739392)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.252; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435132555950030848)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.253; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1435132555950030848)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.254; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11]} 0 9
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.258; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1435132555959468032)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.264; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435132555962613760)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.265; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1435132555962613760)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.269; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1435132555971002368)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.279; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435132555978342400)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.280; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[13 (1435132555978342400)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.281; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13]} 0 9
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.285; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1435132555987779584)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.295; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435132555995119616)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.296; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1435132555995119616)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.297; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14]} 0 9
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.301; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435132556004556800)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.307; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435132556007702528)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.308; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435132556007702528)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.312; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1435132556016091136)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.318; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435132556019236864)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.319; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1435132556019236864)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.323; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1435132556027625472)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.333; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435132556034965504)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.334; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1435132556034965504)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.334; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.339; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1435132556045451264)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.346; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435132556048596992)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.347; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1435132556048596992)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.351; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1435132556058034176)]} 0 0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.362; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435132556066422784)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.363; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[19 (1435132556066422784)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.364; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19]} 0 9
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.368; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1435132556074811392)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.375; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435132556079005696)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.376; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1435132556079005696)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.380; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1435132556088442880)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.387; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435132556091588608)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.388; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1435132556091588608)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.391; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1435132556098928640)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.401; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435132556106268672)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.401; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1435132556106268672)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.402; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.406; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1435132556114657280)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.416; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435132556121997312)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.416; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[23 (1435132556121997312)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.417; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.421; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24 (1435132556130385920)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.431; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435132556137725952)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.431; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[24 (1435132556137725952)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.432; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.436; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1435132556146114560)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.446; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435132556153454592)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.446; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1435132556153454592)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.447; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.451; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26 (1435132556161843200)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.461; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435132556169183232)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.462; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1435132556169183232)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.462; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.466; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27 (1435132556177571840)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.476; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435132556184911872)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.477; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[27 (1435132556184911872)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.477; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.481; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28 (1435132556193300480)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.490; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435132556199591936)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.491; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[28 (1435132556199591936)]} 0 5
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.492; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28]} 0 8
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.495; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1435132556209029120)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.502; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435132556212174848)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.502; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1435132556212174848)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.506; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1435132556219514880)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.512; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435132556222660608)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.512; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1435132556222660608)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.516; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1435132556230000640)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.523; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435132556234194944)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.523; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[31 (1435132556234194944)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.524; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31]} 0 7
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.528; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1435132556242583552)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.536; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:50835/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435132556247826432)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.536; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[32 (1435132556247826432)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.537; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32]} 0 7
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.540; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1435132556256215040)]} 0 0
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.547; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:11334/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435132556259360768)]} 0 1
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.547; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1435132556259360768)]} 0 4
[junit4:junit4] 2> INFO - 2013-05-15 20:17:39.551; org.apache.solr.update.processor
[...truncated too long message...]
ne.store.NativeFSLockFactory@7389f56e),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.MMapDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/index3704937056tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@7389f56e),segFN=segments_5,generation=5}
[junit4:junit4] 2> INFO - 2013-05-15 20:21:37.436; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 5
[junit4:junit4] 2> ERROR - 2013-05-15 20:21:37.437; org.apache.solr.update.TransactionLog; Error: Forcing close of tlog{file=./org.apache.solr.cloud.ShardSplitTest-1368649235005/jetty3/tlog/tlog.0000000000000000002 refcount=1}
[junit4:junit4] 2> ERROR - 2013-05-15 20:21:37.438; org.apache.solr.update.TransactionLog; Error: Forcing close of tlog{file=./org.apache.solr.cloud.ShardSplitTest-1368649235005/jetty3/tlog/tlog.0000000000000000001 refcount=1}
[junit4:junit4] 2> INFO - 2013-05-15 20:21:37.440; org.apache.solr.core.SolrCore; [collection1] Closing main searcher on request.
[junit4:junit4] 2> INFO - 2013-05-15 20:21:37.441; org.apache.solr.core.CachingDirectoryFactory; Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> INFO - 2013-05-15 20:21:37.441; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ShardSplitTest-1368649235005/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368649235005/jetty3;done=false>>]
[junit4:junit4] 2> INFO - 2013-05-15 20:21:37.442; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368649235005/jetty3
[junit4:junit4] 2> INFO - 2013-05-15 20:21:37.442; org.apache.solr.core.CachingDirectoryFactory; looking to close ./org.apache.solr.cloud.ShardSplitTest-1368649235005/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368649235005/jetty3/index;done=false>>]
[junit4:junit4] 2> INFO - 2013-05-15 20:21:37.442; org.apache.solr.core.CachingDirectoryFactory; Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368649235005/jetty3/index
[junit4:junit4] 2> INFO - 2013-05-15 20:21:37.443; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> WARN - 2013-05-15 20:21:37.443; org.apache.solr.cloud.LeaderElector$1;
[junit4:junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89695796265746442-4-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:246)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2> INFO - 2013-05-15 20:21:37.444; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> WARN - 2013-05-15 20:21:37.444; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> WARN - 2013-05-15 20:21:37.445; org.apache.solr.common.cloud.ZkStateReader$3; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> INFO - 2013-05-15 20:21:37.445; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> WARN - 2013-05-15 20:21:37.446; org.apache.solr.common.cloud.ZkStateReader$2; ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> WARN - 2013-05-15 20:21:37.446; org.apache.solr.cloud.LeaderElector$1;
[junit4:junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=MockFixedIntBlock(blockSize=1223), _version_=Lucene41(blocksize=128)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=tr_TR, timezone=Pacific/Funafuti
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=2,free=125425568,total=413138944
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestStressLucene, MBeansHandlerTest, DistributedTermsComponentTest, DirectSolrConnectionTest, TestAddFieldRealTimeGet, TestSolrXMLSerializer, TestAtomicUpdateErrorCases, RequestHandlersTest, TestFastWriter, TestWordDelimiterFilterFactory, FastVectorHighlighterTest, UnloadDistributedZkTest, TestCloudManagedSchemaAddField, TestFastLRUCache, AutoCommitTest, LeaderElectionTest, TestFuzzyAnalyzedSuggestions, XmlUpdateRequestHandlerTest, TestRandomFaceting, TestSweetSpotSimilarityFactory, TestUpdate, TestIBSimilarityFactory, SyncSliceTest, TestFunctionQuery, SolrCoreCheckLockOnStartupTest, TestPostingsSolrHighlighter, TestDistributedGrouping, CoreAdminHandlerTest, TestSolrDeletionPolicy2, DateFieldTest, TestQuerySenderListener, TestCoreContainer, ScriptEngineTest, SliceStateTest, TestRecovery, TestReversedWildcardFilterFactory, SortByFunctionTest, SolrCmdDistributorTest, TestQuerySenderNoQuery, DistanceFunctionTest, TestCodecSupport, CacheHeaderTest, TestCollationKeyRangeQueries, RegexBoostProcessorTest, SliceStateUpdateTest, DebugComponentTest, TestBinaryResponseWriter, TimeZoneUtilsTest, TestCharFilters, TestSchemaResource, TestRandomDVFaceting, TestJmxMonitoredMap, TestCloudManagedSchema, TestDynamicFieldCollectionResource, DocValuesMultiTest, TestSuggestSpellingConverter, TestTrie, MinimalSchemaTest, TestPHPSerializedResponseWriter, DirectUpdateHandlerTest, HardAutoCommitTest, SolrRequestParserTest, TestOmitPositions, TestFieldResource, OverseerCollectionProcessorTest, DocValuesTest, QueryResultKeyTest, ResourceLoaderTest, AlternateDirectoryTest, TermVectorComponentTest, TestSurroundQueryParser, OpenExchangeRatesOrgProviderTest, ChaosMonkeyShardSplitTest, ShardSplitTest]
[junit4:junit4] Completed on J0 in 62.85s, 1 test, 1 error <<< FAILURES!
[...truncated 458 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:383: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:363: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 2 errors, 27 ignored (8 assumptions)
Total time: 49 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure