You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/05/22 02:37:41 UTC
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1272 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1272/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:25762 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:25762 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([ED402A89370D4B6F:6CA6A49140522B53]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9573 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 643953 T1866 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 643959 T1866 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1369181908790
[junit4:junit4] 2> 643961 T1866 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 643962 T1867 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 644063 T1866 oasc.ZkTestServer.run start zk server on port:25751
[junit4:junit4] 2> 644064 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 644089 T1873 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f073f93 name:ZooKeeperConnection Watcher:127.0.0.1:25751 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 644090 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 644090 T1866 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 644094 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 644096 T1875 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2535ef70 name:ZooKeeperConnection Watcher:127.0.0.1:25751/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 644096 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 644097 T1866 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 644100 T1866 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 644102 T1866 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 644104 T1866 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 644107 T1866 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 644107 T1866 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 644113 T1866 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 644114 T1866 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 644217 T1866 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 644218 T1866 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 644221 T1866 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 644222 T1866 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 644225 T1866 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 644226 T1866 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 644229 T1866 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 644229 T1866 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 644237 T1866 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 644238 T1866 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 644241 T1866 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 644242 T1866 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 644245 T1866 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 644246 T1866 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 644515 T1866 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 644521 T1866 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25754
[junit4:junit4] 2> 644522 T1866 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 644522 T1866 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 644523 T1866 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369181909085
[junit4:junit4] 2> 644523 T1866 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369181909085/solr.xml
[junit4:junit4] 2> 644524 T1866 oasc.CoreContainer.<init> New CoreContainer 315243809
[junit4:junit4] 2> 644525 T1866 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369181909085/'
[junit4:junit4] 2> 644525 T1866 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369181909085/'
[junit4:junit4] 2> 644653 T1866 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 644653 T1866 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 644654 T1866 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 644655 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 644655 T1866 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 644656 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 644656 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 644657 T1866 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 644657 T1866 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 644658 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 644675 T1866 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 644676 T1866 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25751/solr
[junit4:junit4] 2> 644677 T1866 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 644678 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 644680 T1886 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50b7bbcd name:ZooKeeperConnection Watcher:127.0.0.1:25751 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 644681 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 644683 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 644695 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 644698 T1888 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42bcf6b name:ZooKeeperConnection Watcher:127.0.0.1:25751/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 644698 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 644700 T1866 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 644711 T1866 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 644714 T1866 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 644717 T1866 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25754_
[junit4:junit4] 2> 644724 T1866 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25754_
[junit4:junit4] 2> 644727 T1866 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 644741 T1866 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 644744 T1866 oasc.Overseer.start Overseer (id=89730705574920195-127.0.0.1:25754_-n_0000000000) starting
[junit4:junit4] 2> 644755 T1866 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 644764 T1890 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 644765 T1866 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 644772 T1866 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 644774 T1866 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 644777 T1889 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 644781 T1891 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369181909085/collection1
[junit4:junit4] 2> 644781 T1891 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 644782 T1891 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 644782 T1891 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 644783 T1891 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369181909085/collection1/'
[junit4:junit4] 2> 644785 T1891 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369181909085/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 644786 T1891 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369181909085/collection1/lib/README' to classloader
[junit4:junit4] 2> 644838 T1891 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 644897 T1891 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 644999 T1891 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 645005 T1891 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 645578 T1891 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 645582 T1891 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 645585 T1891 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 645590 T1891 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 645614 T1891 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 645614 T1891 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369181909085/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/control/data/
[junit4:junit4] 2> 645615 T1891 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4e6fe5
[junit4:junit4] 2> 645615 T1891 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 645616 T1891 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/control/data
[junit4:junit4] 2> 645616 T1891 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/control/data/index/
[junit4:junit4] 2> 645617 T1891 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 645617 T1891 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/control/data/index
[junit4:junit4] 2> 645622 T1891 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@75938d2d lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ef48c0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 645622 T1891 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 645626 T1891 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 645626 T1891 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 645627 T1891 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 645627 T1891 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 645628 T1891 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 645628 T1891 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 645629 T1891 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 645629 T1891 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 645630 T1891 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 645646 T1891 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 645653 T1891 oass.SolrIndexSearcher.<init> Opening Searcher@667e13a2 main
[junit4:junit4] 2> 645653 T1891 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/control/data/tlog
[junit4:junit4] 2> 645655 T1891 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 645655 T1891 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 645658 T1892 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@667e13a2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 645661 T1891 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 645661 T1891 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 646280 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 646281 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25754_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25754"}
[junit4:junit4] 2> 646281 T1889 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 646282 T1889 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 646295 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 646670 T1891 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 646670 T1891 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25754 collection:control_collection shard:shard1
[junit4:junit4] 2> 646671 T1891 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 646701 T1891 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 646704 T1891 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 646705 T1891 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 646705 T1891 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:25754/collection1/
[junit4:junit4] 2> 646705 T1891 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 646705 T1891 oasc.SyncStrategy.syncToMe http://127.0.0.1:25754/collection1/ has no replicas
[junit4:junit4] 2> 646706 T1891 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:25754/collection1/
[junit4:junit4] 2> 646706 T1891 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 647799 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 647817 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 647834 T1891 oasc.ZkController.register We are http://127.0.0.1:25754/collection1/ and leader is http://127.0.0.1:25754/collection1/
[junit4:junit4] 2> 647834 T1891 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25754
[junit4:junit4] 2> 647834 T1891 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 647834 T1891 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 647835 T1891 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 647836 T1891 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 647837 T1866 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 647838 T1866 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 647839 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 647856 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 647858 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 647860 T1895 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75590f4e name:ZooKeeperConnection Watcher:127.0.0.1:25751/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 647861 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 647862 T1866 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 647864 T1866 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 648124 T1866 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 648128 T1866 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25762
[junit4:junit4] 2> 648129 T1866 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 648129 T1866 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 648130 T1866 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369181912693
[junit4:junit4] 2> 648130 T1866 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369181912693/solr.xml
[junit4:junit4] 2> 648131 T1866 oasc.CoreContainer.<init> New CoreContainer 1122384222
[junit4:junit4] 2> 648132 T1866 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369181912693/'
[junit4:junit4] 2> 648132 T1866 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369181912693/'
[junit4:junit4] 2> 648259 T1866 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 648260 T1866 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 648261 T1866 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 648261 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 648262 T1866 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 648262 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 648263 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 648263 T1866 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 648264 T1866 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 648265 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 648282 T1866 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 648283 T1866 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25751/solr
[junit4:junit4] 2> 648283 T1866 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 648284 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 648287 T1906 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20b405ff name:ZooKeeperConnection Watcher:127.0.0.1:25751 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 648288 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 648298 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 648310 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 648312 T1908 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2de7a7a1 name:ZooKeeperConnection Watcher:127.0.0.1:25751/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 648313 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 648324 T1866 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 649327 T1866 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25762_
[junit4:junit4] 2> 649337 T1866 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25762_
[junit4:junit4] 2> 649337 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 649338 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:25754__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25754_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25754"}
[junit4:junit4] 2> 649339 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 649352 T1908 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 649352 T1895 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 649364 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 649364 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 649367 T1888 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 649367 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 649369 T1909 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369181912693/collection1
[junit4:junit4] 2> 649369 T1909 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 649370 T1909 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 649370 T1909 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 649372 T1909 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369181912693/collection1/'
[junit4:junit4] 2> 649373 T1909 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369181912693/collection1/lib/README' to classloader
[junit4:junit4] 2> 649374 T1909 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369181912693/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 649425 T1909 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 649485 T1909 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 649586 T1909 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 649592 T1909 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 650159 T1909 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 650163 T1909 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 650165 T1909 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 650171 T1909 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 650195 T1909 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 650195 T1909 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369181912693/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty1/
[junit4:junit4] 2> 650196 T1909 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4e6fe5
[junit4:junit4] 2> 650196 T1909 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 650197 T1909 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty1
[junit4:junit4] 2> 650198 T1909 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty1/index/
[junit4:junit4] 2> 650198 T1909 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 650199 T1909 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty1/index
[junit4:junit4] 2> 650202 T1909 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3fe889e6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c778824),segFN=segments_1,generation=1}
[junit4:junit4] 2> 650203 T1909 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 650206 T1909 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 650207 T1909 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 650208 T1909 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 650208 T1909 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 650209 T1909 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 650209 T1909 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 650210 T1909 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 650210 T1909 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 650211 T1909 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 650227 T1909 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 650235 T1909 oass.SolrIndexSearcher.<init> Opening Searcher@797968ab main
[junit4:junit4] 2> 650235 T1909 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty1/tlog
[junit4:junit4] 2> 650236 T1909 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 650237 T1909 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 650242 T1910 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@797968ab main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 650245 T1909 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 650245 T1909 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 650868 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 650869 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25762_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25762"}
[junit4:junit4] 2> 650869 T1889 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 650869 T1889 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 650911 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 650911 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 650911 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 651254 T1909 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 651254 T1909 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25762 collection:collection1 shard:shard1
[junit4:junit4] 2> 651255 T1909 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 651275 T1909 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 651286 T1909 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 651286 T1909 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 651287 T1909 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:25762/collection1/
[junit4:junit4] 2> 651287 T1909 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 651287 T1909 oasc.SyncStrategy.syncToMe http://127.0.0.1:25762/collection1/ has no replicas
[junit4:junit4] 2> 651288 T1909 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:25762/collection1/
[junit4:junit4] 2> 651288 T1909 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 652415 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 652431 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 652431 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 652431 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 652474 T1909 oasc.ZkController.register We are http://127.0.0.1:25762/collection1/ and leader is http://127.0.0.1:25762/collection1/
[junit4:junit4] 2> 652474 T1909 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25762
[junit4:junit4] 2> 652474 T1909 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 652474 T1909 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 652475 T1909 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 652476 T1909 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 652477 T1866 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 652478 T1866 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 652479 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 652754 T1866 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 652758 T1866 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25767
[junit4:junit4] 2> 652758 T1866 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 652759 T1866 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 652760 T1866 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369181917323
[junit4:junit4] 2> 652760 T1866 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369181917323/solr.xml
[junit4:junit4] 2> 652761 T1866 oasc.CoreContainer.<init> New CoreContainer 1337719246
[junit4:junit4] 2> 652761 T1866 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369181917323/'
[junit4:junit4] 2> 652762 T1866 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369181917323/'
[junit4:junit4] 2> 652889 T1866 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 652890 T1866 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 652891 T1866 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 652891 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 652892 T1866 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 652892 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 652893 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 652893 T1866 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 652894 T1866 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 652894 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 652910 T1866 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 652911 T1866 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25751/solr
[junit4:junit4] 2> 652911 T1866 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 652912 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 652916 T1922 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16cec71c name:ZooKeeperConnection Watcher:127.0.0.1:25751 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 652916 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 652931 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 652942 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 652944 T1924 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52260793 name:ZooKeeperConnection Watcher:127.0.0.1:25751/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 652945 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 652950 T1866 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 653937 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 653938 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:25762__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25762_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25762"}
[junit4:junit4] 2> 653963 T1866 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25767_
[junit4:junit4] 2> 653994 T1866 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25767_
[junit4:junit4] 2> 653995 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 653995 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 653995 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 653995 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 654035 T1924 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 654035 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 654036 T1895 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 654036 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 654036 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 654055 T1908 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 654055 T1888 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 654060 T1925 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369181917323/collection1
[junit4:junit4] 2> 654061 T1925 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 654061 T1925 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 654061 T1925 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 654063 T1925 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369181917323/collection1/'
[junit4:junit4] 2> 654064 T1925 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369181917323/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 654065 T1925 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369181917323/collection1/lib/README' to classloader
[junit4:junit4] 2> 654117 T1925 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 654177 T1925 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 654278 T1925 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 654284 T1925 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 654852 T1925 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 654856 T1925 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 654858 T1925 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 654864 T1925 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 654887 T1925 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 654888 T1925 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369181917323/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty2/
[junit4:junit4] 2> 654888 T1925 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4e6fe5
[junit4:junit4] 2> 654889 T1925 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 654890 T1925 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty2
[junit4:junit4] 2> 654890 T1925 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty2/index/
[junit4:junit4] 2> 654890 T1925 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 654891 T1925 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty2/index
[junit4:junit4] 2> 654895 T1925 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42ad4ad2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@61a929ea),segFN=segments_1,generation=1}
[junit4:junit4] 2> 654895 T1925 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 654899 T1925 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 654899 T1925 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 654900 T1925 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 654901 T1925 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 654901 T1925 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 654902 T1925 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 654902 T1925 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 654903 T1925 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 654903 T1925 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 654920 T1925 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 654927 T1925 oass.SolrIndexSearcher.<init> Opening Searcher@60236206 main
[junit4:junit4] 2> 654928 T1925 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty2/tlog
[junit4:junit4] 2> 654929 T1925 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 654929 T1925 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 654934 T1926 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60236206 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 654937 T1925 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 654937 T1925 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 655537 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 655538 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25767_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25767"}
[junit4:junit4] 2> 655539 T1889 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 655539 T1889 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 655551 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 655551 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 655551 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 655551 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 655940 T1925 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 655940 T1925 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25767 collection:collection1 shard:shard2
[junit4:junit4] 2> 655941 T1925 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 655959 T1925 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 655968 T1925 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 655969 T1925 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 655969 T1925 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:25767/collection1/
[junit4:junit4] 2> 655969 T1925 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 655970 T1925 oasc.SyncStrategy.syncToMe http://127.0.0.1:25767/collection1/ has no replicas
[junit4:junit4] 2> 655970 T1925 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:25767/collection1/
[junit4:junit4] 2> 655970 T1925 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 657055 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 657098 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 657098 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 657098 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 657098 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 657148 T1925 oasc.ZkController.register We are http://127.0.0.1:25767/collection1/ and leader is http://127.0.0.1:25767/collection1/
[junit4:junit4] 2> 657148 T1925 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25767
[junit4:junit4] 2> 657148 T1925 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 657149 T1925 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 657149 T1925 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 657151 T1925 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 657152 T1866 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 657153 T1866 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 657154 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 657484 T1866 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 657488 T1866 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:35578
[junit4:junit4] 2> 657488 T1866 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 657489 T1866 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 657489 T1866 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369181922001
[junit4:junit4] 2> 657490 T1866 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369181922001/solr.xml
[junit4:junit4] 2> 657490 T1866 oasc.CoreContainer.<init> New CoreContainer 243414124
[junit4:junit4] 2> 657491 T1866 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369181922001/'
[junit4:junit4] 2> 657492 T1866 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369181922001/'
[junit4:junit4] 2> 657617 T1866 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 657618 T1866 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 657619 T1866 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 657619 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 657620 T1866 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 657620 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 657621 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 657621 T1866 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 657621 T1866 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 657622 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 657637 T1866 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 657638 T1866 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25751/solr
[junit4:junit4] 2> 657638 T1866 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 657639 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 657642 T1938 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26a17f04 name:ZooKeeperConnection Watcher:127.0.0.1:25751 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 657643 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 657645 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 657655 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 657657 T1940 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10766ecf name:ZooKeeperConnection Watcher:127.0.0.1:25751/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 657657 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 657669 T1866 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 658612 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 658613 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:25767__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25767_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25767"}
[junit4:junit4] 2> 658672 T1940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 658672 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 658672 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 658672 T1866 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35578_
[junit4:junit4] 2> 658672 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 658672 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 658738 T1866 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35578_
[junit4:junit4] 2> 658740 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 658740 T1940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 658740 T1895 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 658740 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 658741 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 658740 T1924 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 658741 T1888 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 658742 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 658757 T1940 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 658757 T1908 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 658763 T1941 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369181922001/collection1
[junit4:junit4] 2> 658763 T1941 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 658764 T1941 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 658764 T1941 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 658766 T1941 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369181922001/collection1/'
[junit4:junit4] 2> 658767 T1941 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369181922001/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 658768 T1941 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369181922001/collection1/lib/README' to classloader
[junit4:junit4] 2> 658819 T1941 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 658878 T1941 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 658979 T1941 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 658985 T1941 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 659571 T1941 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 659575 T1941 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 659577 T1941 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 659583 T1941 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 659608 T1941 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 659609 T1941 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369181922001/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3/
[junit4:junit4] 2> 659609 T1941 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4e6fe5
[junit4:junit4] 2> 659610 T1941 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 659611 T1941 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3
[junit4:junit4] 2> 659611 T1941 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3/index/
[junit4:junit4] 2> 659611 T1941 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 659612 T1941 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3/index
[junit4:junit4] 2> 659616 T1941 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45cfd16f lockFactory=org.apache.lucene.store.NativeFSLockFactory@58f8258d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 659616 T1941 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 659620 T1941 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 659620 T1941 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 659621 T1941 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 659622 T1941 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 659623 T1941 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 659623 T1941 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 659624 T1941 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 659624 T1941 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 659625 T1941 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 659647 T1941 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 659655 T1941 oass.SolrIndexSearcher.<init> Opening Searcher@5325f70d main
[junit4:junit4] 2> 659656 T1941 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3/tlog
[junit4:junit4] 2> 659657 T1941 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 659658 T1941 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 659663 T1942 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5325f70d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 659667 T1941 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 659667 T1941 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 660240 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 660241 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35578_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35578"}
[junit4:junit4] 2> 660241 T1889 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 660241 T1889 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 660254 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 660254 T1940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 660254 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 660254 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 660254 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 660670 T1941 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 660670 T1941 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35578 collection:collection1 shard:shard1
[junit4:junit4] 2> 660673 T1941 oasc.ZkController.register We are http://127.0.0.1:35578/collection1/ and leader is http://127.0.0.1:25762/collection1/
[junit4:junit4] 2> 660674 T1941 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35578
[junit4:junit4] 2> 660674 T1941 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 660674 T1941 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C253 name=collection1 org.apache.solr.core.SolrCore@4110eecd url=http://127.0.0.1:35578/collection1 node=127.0.0.1:35578_ C253_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:35578_, base_url=http://127.0.0.1:35578}
[junit4:junit4] 2> 660675 T1943 C253 P35578 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 660675 T1941 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 660676 T1943 C253 P35578 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 660676 T1943 C253 P35578 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 660677 T1943 C253 P35578 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 660677 T1866 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 660678 T1866 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 660678 T1943 C253 P35578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 660678 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 660700 T1898 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:35578__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 660979 T1866 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 660982 T1866 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49943
[junit4:junit4] 2> 660983 T1866 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 660984 T1866 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 660984 T1866 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369181925527
[junit4:junit4] 2> 660985 T1866 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369181925527/solr.xml
[junit4:junit4] 2> 660985 T1866 oasc.CoreContainer.<init> New CoreContainer 1000646797
[junit4:junit4] 2> 660986 T1866 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369181925527/'
[junit4:junit4] 2> 660987 T1866 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369181925527/'
[junit4:junit4] 2> 661121 T1866 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 661122 T1866 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 661123 T1866 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 661123 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 661124 T1866 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 661124 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 661125 T1866 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 661125 T1866 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 661126 T1866 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 661127 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 661144 T1866 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 661146 T1866 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25751/solr
[junit4:junit4] 2> 661146 T1866 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 661147 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 661150 T1955 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21725e1b name:ZooKeeperConnection Watcher:127.0.0.1:25751 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 661150 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 661153 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 661166 T1866 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 661173 T1957 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11ed9796 name:ZooKeeperConnection Watcher:127.0.0.1:25751/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 661174 T1866 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 661193 T1866 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 661758 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 661759 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:35578__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35578_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35578"}
[junit4:junit4] 2> 661771 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 661771 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 661771 T1957 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 661771 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 661771 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 661771 T1940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 662197 T1866 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49943_
[junit4:junit4] 2> 662203 T1866 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49943_
[junit4:junit4] 2> 662205 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 662205 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 662206 T1957 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 662205 T1940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 662206 T1957 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 662206 T1895 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 662207 T1908 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 662206 T1924 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 662207 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 662207 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 662208 T1888 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 662208 T1940 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 662214 T1958 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369181925527/collection1
[junit4:junit4] 2> 662214 T1958 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 662215 T1958 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 662215 T1958 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 662216 T1958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369181925527/collection1/'
[junit4:junit4] 2> 662218 T1958 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369181925527/collection1/lib/README' to classloader
[junit4:junit4] 2> 662218 T1958 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369181925527/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 662273 T1958 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 662331 T1958 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 662433 T1958 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 662437 T1958 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 662702 T1898 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:35578__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 662702 T1898 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:35578__collection1&state=recovering&nodeName=127.0.0.1:35578_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 662824 T1958 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 662827 T1958 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 662828 T1958 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 662832 T1958 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 662853 T1958 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 662853 T1958 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369181925527/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/
[junit4:junit4] 2> 662853 T1958 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c4e6fe5
[junit4:junit4] 2> 662854 T1958 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 662854 T1958 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4
[junit4:junit4] 2> 662854 T1958 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index/
[junit4:junit4] 2> 662855 T1958 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 662856 T1958 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index
[junit4:junit4] 2> 662859 T1958 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b58e1f7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@64d703e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 662859 T1958 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 662861 T1958 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 662862 T1958 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 662862 T1958 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 662863 T1958 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 662863 T1958 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 662863 T1958 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 662864 T1958 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 662864 T1958 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 662865 T1958 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 662875 T1958 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 662880 T1958 oass.SolrIndexSearcher.<init> Opening Searcher@215dbf46 main
[junit4:junit4] 2> 662880 T1958 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/tlog
[junit4:junit4] 2> 662881 T1958 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 662881 T1958 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 662885 T1959 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@215dbf46 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 662886 T1958 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 662886 T1958 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 663275 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 663276 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49943_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49943"}
[junit4:junit4] 2> 663276 T1889 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 663276 T1889 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 663289 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 663289 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 663289 T1940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 663289 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 663289 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 663289 T1957 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 663889 T1958 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 663889 T1958 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49943 collection:collection1 shard:shard2
[junit4:junit4] 2> 663892 T1958 oasc.ZkController.register We are http://127.0.0.1:49943/collection1/ and leader is http://127.0.0.1:25767/collection1/
[junit4:junit4] 2> 663893 T1958 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49943
[junit4:junit4] 2> 663893 T1958 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 663893 T1958 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C254 name=collection1 org.apache.solr.core.SolrCore@1ac864a3 url=http://127.0.0.1:49943/collection1 node=127.0.0.1:49943_ C254_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:49943_, base_url=http://127.0.0.1:49943}
[junit4:junit4] 2> 663894 T1960 C254 P49943 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 663894 T1958 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 663895 T1960 C254 P49943 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 663896 T1960 C254 P49943 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 663896 T1960 C254 P49943 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 663896 T1866 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 663897 T1866 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 663897 T1960 C254 P49943 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 663898 T1866 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 663921 T1866 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 663922 T1914 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:49943__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 663922 T1866 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 663923 T1866 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 663924 T1866 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C255 name=collection1 org.apache.solr.core.SolrCore@4110eecd url=http://127.0.0.1:35578/collection1 node=127.0.0.1:35578_ C255_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:35578_, base_url=http://127.0.0.1:35578}
[junit4:junit4] 2> 664704 T1943 C255 P35578 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:25762/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 664704 T1943 C255 P35578 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35578 START replicas=[http://127.0.0.1:25762/collection1/] nUpdates=100
[junit4:junit4] 2> 664705 T1943 C255 P35578 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 664706 T1943 C255 P35578 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 664706 T1943 C255 P35578 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 664707 T1943 C255 P35578 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 664707 T1943 C255 P35578 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 664707 T1943 C255 P35578 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:25762/collection1/. core=collection1
[junit4:junit4] 2> 664707 T1943 C255 P35578 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C256 name=collection1 org.apache.solr.core.SolrCore@4c235e6c url=http://127.0.0.1:25762/collection1 node=127.0.0.1:25762_ C256_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:25762_, base_url=http://127.0.0.1:25762, leader=true}
[junit4:junit4] 2> 664715 T1899 C256 P25762 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 664719 T1900 C256 P25762 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 664722 T1900 C256 P25762 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3fe889e6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c778824),segFN=segments_1,generation=1}
[junit4:junit4] 2> 664723 T1900 C256 P25762 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 664724 T1900 C256 P25762 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3fe889e6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c778824),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3fe889e6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c778824),segFN=segments_2,generation=2}
[junit4:junit4] 2> 664724 T1900 C256 P25762 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 664725 T1900 C256 P25762 oass.SolrIndexSearcher.<init> Opening Searcher@52443768 realtime
[junit4:junit4] 2> 664725 T1900 C256 P25762 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 664726 T1900 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 664727 T1943 C255 P35578 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 664727 T1943 C255 P35578 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 664729 T1901 C256 P25762 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 664729 T1901 C256 P25762 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 664730 T1943 C255 P35578 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 664730 T1943 C255 P35578 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 664730 T1943 C255 P35578 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 664733 T1901 C256 P25762 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 664734 T1943 C255 P35578 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 664735 T1943 C255 P35578 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3/index.20130521221849563
[junit4:junit4] 2> 664735 T1943 C255 P35578 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@493134d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@72e71ff5) fullCopy=false
[junit4:junit4] 2> 664738 T1901 C256 P25762 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 664739 T1943 C255 P35578 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 664740 T1943 C255 P35578 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 664741 T1943 C255 P35578 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 664743 T1943 C255 P35578 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45cfd16f lockFactory=org.apache.lucene.store.NativeFSLockFactory@58f8258d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45cfd16f lockFactory=org.apache.lucene.store.NativeFSLockFactory@58f8258d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 664743 T1943 C255 P35578 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 664744 T1943 C255 P35578 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 664744 T1943 C255 P35578 oass.SolrIndexSearcher.<init> Opening Searcher@58f9d0f5 main
[junit4:junit4] 2> 664745 T1942 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@58f9d0f5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 664746 T1943 C255 P35578 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3/index.20130521221849563 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3/index.20130521221849563;done=true>>]
[junit4:junit4] 2> 664746 T1943 C255 P35578 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3/index.20130521221849563
[junit4:junit4] 2> 664747 T1943 C255 P35578 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty3/index.20130521221849563
[junit4:junit4] 2> 664747 T1943 C255 P35578 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 664747 T1943 C255 P35578 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 664747 T1943 C255 P35578 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 664747 T1943 C255 P35578 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 664749 T1943 C255 P35578 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 664793 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 664794 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:49943__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49943_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49943"}
[junit4:junit4] 2> 664797 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:35578__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35578_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35578"}
[junit4:junit4] 2> 664813 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 664813 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 664813 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 664813 T1957 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 664813 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 664813 T1940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 664923 T1914 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:49943__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 664923 T1914 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:49943__collection1&state=recovering&nodeName=127.0.0.1:49943_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 664926 T1866 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 665928 T1866 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C254_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:49943_, base_url=http://127.0.0.1:49943}
[junit4:junit4] 2> 666925 T1960 C254 P49943 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:25767/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 666925 T1960 C254 P49943 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:49943 START replicas=[http://127.0.0.1:25767/collection1/] nUpdates=100
[junit4:junit4] 2> 666926 T1960 C254 P49943 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 666926 T1960 C254 P49943 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 666926 T1960 C254 P49943 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 666926 T1960 C254 P49943 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 666927 T1960 C254 P49943 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 666927 T1960 C254 P49943 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:25767/collection1/. core=collection1
[junit4:junit4] 2> 666927 T1960 C254 P49943 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 666930 T1866 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C257 name=collection1 org.apache.solr.core.SolrCore@8e20c43 url=http://127.0.0.1:25767/collection1 node=127.0.0.1:25767_ C257_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:25767_, base_url=http://127.0.0.1:25767, leader=true}
[junit4:junit4] 2> 666935 T1915 C257 P25767 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 666940 T1916 C257 P25767 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 666943 T1916 C257 P25767 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42ad4ad2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@61a929ea),segFN=segments_1,generation=1}
[junit4:junit4] 2> 666944 T1916 C257 P25767 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 666945 T1916 C257 P25767 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42ad4ad2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@61a929ea),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42ad4ad2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@61a929ea),segFN=segments_2,generation=2}
[junit4:junit4] 2> 666945 T1916 C257 P25767 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 666946 T1916 C257 P25767 oass.SolrIndexSearcher.<init> Opening Searcher@4e7fe31c realtime
[junit4:junit4] 2> 666946 T1916 C257 P25767 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 666947 T1916 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 666948 T1960 C254 P49943 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 666948 T1960 C254 P49943 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 666950 T1917 C257 P25767 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 666951 T1917 C257 P25767 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 666951 T1960 C254 P49943 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 666952 T1960 C254 P49943 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 666952 T1960 C254 P49943 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 666954 T1917 C257 P25767 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 666955 T1960 C254 P49943 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 666956 T1960 C254 P49943 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index.20130521221851784
[junit4:junit4] 2> 666956 T1960 C254 P49943 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@471e8ede lockFactory=org.apache.lucene.store.NativeFSLockFactory@67533b0e) fullCopy=false
[junit4:junit4] 2> 666959 T1917 C257 P25767 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 666960 T1960 C254 P49943 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 666961 T1960 C254 P49943 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 666962 T1960 C254 P49943 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 666963 T1960 C254 P49943 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b58e1f7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@64d703e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b58e1f7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@64d703e),segFN=segments_2,generation=2}
[junit4:junit4] 2> 666964 T1960 C254 P49943 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 666964 T1960 C254 P49943 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 666965 T1960 C254 P49943 oass.SolrIndexSearcher.<init> Opening Searcher@1e62030e main
[junit4:junit4] 2> 666966 T1959 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e62030e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 666967 T1960 C254 P49943 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index.20130521221851784 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index.20130521221851784;done=true>>]
[junit4:junit4] 2> 666967 T1960 C254 P49943 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index.20130521221851784
[junit4:junit4] 2> 666967 T1960 C254 P49943 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index.20130521221851784
[junit4:junit4] 2> 666968 T1960 C254 P49943 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 666968 T1960 C254 P49943 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 666968 T1960 C254 P49943 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 666968 T1960 C254 P49943 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 666970 T1960 C254 P49943 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 667827 T1889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 667828 T1889 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:49943__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49943_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49943"}
[junit4:junit4] 2> 667841 T1908 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 667841 T1895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 667841 T1940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 667841 T1888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 667841 T1924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 667841 T1957 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 667932 T1866 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 667933 T1866 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C258 name=collection1 org.apache.solr.core.SolrCore@278fbe30 url=http://127.0.0.1:25754/collection1 node=127.0.0.1:25754_ C258_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:25754_, base_url=http://127.0.0.1:25754, leader=true}
[junit4:junit4] 2> 667942 T1878 C258 P25754 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 667946 T1878 C258 P25754 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@75938d2d lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ef48c0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 667946 T1878 C258 P25754 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 667947 T1878 C258 P25754 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@75938d2d lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ef48c0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@75938d2d lockFactory=org.apache.lucene.store.NativeFSLockFactory@70ef48c0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 667948 T1878 C258 P25754 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 667948 T1878 C258 P25754 oass.SolrIndexSearcher.<init> Opening Searcher@2e189358 main
[junit4:junit4] 2> 667949 T1878 C258 P25754 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 667950 T1892 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2e189358 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 667951 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 667962 T1918 C257 P25767 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 667964 T1918 C257 P25767 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42ad4ad2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@61a929ea),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42ad4ad2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@61a929ea),segFN=segments_3,generation=3}
[junit4:junit4] 2> 667964 T1918 C257 P25767 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 667965 T1918 C257 P25767 oass.SolrIndexSearcher.<init> Opening Searcher@37279b7d main
[junit4:junit4] 2> 667965 T1918 C257 P25767 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 667966 T1926 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@37279b7d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 667967 T1918 C257 P25767 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:25762/collection1/, StdNode: http://127.0.0.1:35578/collection1/, StdNode: http://127.0.0.1:49943/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 667970 T1902 C256 P25762 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 667972 T1902 C256 P25762 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3fe889e6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c778824),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3fe889e6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c778824),segFN=segments_3,generation=3}
[junit4:junit4] 2> 667972 T1902 C256 P25762 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 667973 T1902 C256 P25762 oass.SolrIndexSearcher.<init> Opening Searcher@5f3cc375 main
[junit4:junit4] 2> 667973 T1902 C256 P25762 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 667974 T1910 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5f3cc375 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 667975 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C254_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49943_, base_url=http://127.0.0.1:49943}
[junit4:junit4] 2> 667979 T1947 C254 P49943 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C255_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:35578_, base_url=http://127.0.0.1:35578}
[junit4:junit4] 2> 667979 T1930 C255 P35578 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 667980 T1947 C254 P49943 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b58e1f7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@64d703e),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@b58e1f7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@64d703e),segFN=segments_3,generation=3}
[junit4:junit4] 2> 667981 T1930 C255 P35578 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45cfd16f lockFactory=org.apache.lucene.store.NativeFSLockFactory@58f8258d),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45cfd16f lockFactory=org.apache.lucene.store.NativeFSLockFactory@58f8258d),segFN=segments_3,generation=3}
[junit4:junit4] 2> 667981 T1947 C254 P49943 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 667981 T1930 C255 P35578 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 667982 T1947 C254 P49943 oass.SolrIndexSearcher.<init> Opening Searcher@28915fcf main
[junit4:junit4] 2> 667983 T1930 C255 P35578 oass.SolrIndexSearcher.<init> Opening Searcher@4b3988f1 main
[junit4:junit4] 2> 667983 T1947 C254 P49943 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 667984 T1930 C255 P35578 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 667984 T1959 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@28915fcf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 667985 T1942 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4b3988f1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 667985 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 667985 T1930 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 667986 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 24
[junit4:junit4] 2> 667987 T1866 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 667990 T1903 C256 P25762 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 667993 T1931 C255 P35578 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 667995 T1919 C257 P25767 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 667997 T1948 C254 P49943 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 670002 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435691316496302080)} 0 2
[junit4:junit4] 2> 670012 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435691316502593536&update.from=http://127.0.0.1:25767/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435691316502593536)} 0 2
[junit4:junit4] 2> 670016 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435691316506787840&update.from=http://127.0.0.1:25762/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435691316506787840)} 0 1
[junit4:junit4] 2> 670017 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435691316506787840)} 0 7
[junit4:junit4] 2> 670018 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435691316502593536)} 0 12
[junit4:junit4] 2> 670022 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1435691316517273600)]} 0 1
[junit4:junit4] 2> 670028 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435691316520419328)]} 0 1
[junit4:junit4] 2> 670028 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1435691316520419328)]} 0 4
[junit4:junit4] 2> 670031 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435691316527759360)]} 0 0
[junit4:junit4] 2> 670038 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435691316530905088)]} 0 1
[junit4:junit4] 2> 670038 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435691316530905088)]} 0 4
[junit4:junit4] 2> 670042 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1435691316538245120)]} 0 1
[junit4:junit4] 2> 670049 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435691316543488000)]} 0 1
[junit4:junit4] 2> 670049 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1435691316543488000)]} 0 4
[junit4:junit4] 2> 670050 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2]} 0 6
[junit4:junit4] 2> 670053 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435691316550828032)]} 0 0
[junit4:junit4] 2> 670060 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435691316553973760)]} 0 1
[junit4:junit4] 2> 670060 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435691316553973760)]} 0 4
[junit4:junit4] 2> 670063 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435691316561313792)]} 0 0
[junit4:junit4] 2> 670070 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435691316564459520)]} 0 1
[junit4:junit4] 2> 670070 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435691316564459520)]} 0 4
[junit4:junit4] 2> 670073 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1435691316571799552)]} 0 0
[junit4:junit4] 2> 670080 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435691316574945280)]} 0 1
[junit4:junit4] 2> 670080 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1435691316574945280)]} 0 4
[junit4:junit4] 2> 670083 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1435691316582285312)]} 0 0
[junit4:junit4] 2> 670093 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435691316588576768)]} 0 1
[junit4:junit4] 2> 670093 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1435691316588576768)]} 0 4
[junit4:junit4] 2> 670094 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6]} 0 8
[junit4:junit4] 2> 670097 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1435691316596965376)]} 0 0
[junit4:junit4] 2> 670107 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435691316603256832)]} 0 0
[junit4:junit4] 2> 670107 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1435691316603256832)]} 0 4
[junit4:junit4] 2> 670108 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7]} 0 8
[junit4:junit4] 2> 670111 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435691316611645440)]} 0 0
[junit4:junit4] 2> 670118 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435691316614791168)]} 0 1
[junit4:junit4] 2> 670118 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435691316614791168)]} 0 4
[junit4:junit4] 2> 670121 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1435691316622131200)]} 0 0
[junit4:junit4] 2> 670131 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435691316628422656)]} 0 1
[junit4:junit4] 2> 670131 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1435691316628422656)]} 0 4
[junit4:junit4] 2> 670132 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9]} 0 8
[junit4:junit4] 2> 670136 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1435691316636811264)]} 0 1
[junit4:junit4] 2> 670142 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435691316639956992)]} 0 1
[junit4:junit4] 2> 670142 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1435691316639956992)]} 0 4
[junit4:junit4] 2> 670145 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1435691316647297024)]} 0 0
[junit4:junit4] 2> 670151 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435691316650442752)]} 0 0
[junit4:junit4] 2> 670152 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1435691316650442752)]} 0 4
[junit4:junit4] 2> 670155 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1435691316657782784)]} 0 0
[junit4:junit4] 2> 670162 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435691316660928512)]} 0 1
[junit4:junit4] 2> 670162 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1435691316660928512)]} 0 4
[junit4:junit4] 2> 670166 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1435691316668268544)]} 0 0
[junit4:junit4] 2> 670172 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435691316671414272)]} 0 0
[junit4:junit4] 2> 670172 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1435691316671414272)]} 0 4
[junit4:junit4] 2> 670176 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1435691316678754304)]} 0 1
[junit4:junit4] 2> 670182 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435691316681900032)]} 0 1
[junit4:junit4] 2> 670182 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1435691316681900032)]} 0 4
[junit4:junit4] 2> 670185 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435691316689240064)]} 0 0
[junit4:junit4] 2> 670192 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435691316692385792)]} 0 1
[junit4:junit4] 2> 670192 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435691316692385792)]} 0 4
[junit4:junit4] 2> 670195 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1435691316699725824)]} 0 0
[junit4:junit4] 2> 670205 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435691316706017280)]} 0 1
[junit4:junit4] 2> 670205 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[16 (1435691316706017280)]} 0 4
[junit4:junit4] 2> 670206 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16]} 0 8
[junit4:junit4] 2> 670209 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1435691316714405888)]} 0 0
[junit4:junit4] 2> 670216 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435691316717551616)]} 0 1
[junit4:junit4] 2> 670216 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1435691316717551616)]} 0 4
[junit4:junit4] 2> 670219 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1435691316724891648)]} 0 0
[junit4:junit4] 2> 670229 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435691316731183104)]} 0 0
[junit4:junit4] 2> 670230 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[18 (1435691316731183104)]} 0 5
[junit4:junit4] 2> 670231 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18]} 0 9
[junit4:junit4] 2> 670234 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1435691316740620288)]} 0 0
[junit4:junit4] 2> 670240 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435691316743766016)]} 0 0
[junit4:junit4] 2> 670241 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1435691316743766016)]} 0 4
[junit4:junit4] 2> 670244 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1435691316751106048)]} 0 0
[junit4:junit4] 2> 670254 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435691316757397504)]} 0 1
[junit4:junit4] 2> 670255 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[20 (1435691316757397504)]} 0 5
[junit4:junit4] 2> 670255 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20]} 0 8
[junit4:junit4] 2> 670259 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1435691316765786112)]} 0 1
[junit4:junit4] 2> 670265 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435691316768931840)]} 0 1
[junit4:junit4] 2> 670265 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1435691316768931840)]} 0 4
[junit4:junit4] 2> 670269 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1435691316776271872)]} 0 0
[junit4:junit4] 2> 670278 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435691316782563328)]} 0 1
[junit4:junit4] 2> 670278 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1435691316782563328)]} 0 4
[junit4:junit4] 2> 670279 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22]} 0 8
[junit4:junit4] 2> 670282 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1435691316790951936)]} 0 0
[junit4:junit4] 2> 670289 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435691316794097664)]} 0 0
[junit4:junit4] 2> 670289 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1435691316794097664)]} 0 4
[junit4:junit4] 2> 670292 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24 (1435691316801437696)]} 0 0
[junit4:junit4] 2> 670302 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435691316807729152)]} 0 1
[junit4:junit4] 2> 670302 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[24 (1435691316807729152)]} 0 4
[junit4:junit4] 2> 670303 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24]} 0 8
[junit4:junit4] 2> 670307 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1435691316816117760)]} 0 0
[junit4:junit4] 2> 670316 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435691316822409216)]} 0 1
[junit4:junit4] 2> 670316 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1435691316822409216)]} 0 4
[junit4:junit4] 2> 670317 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25]} 0 8
[junit4:junit4] 2> 670321 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26 (1435691316830797824)]} 0 1
[junit4:junit4] 2> 670327 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435691316833943552)]} 0 0
[junit4:junit4] 2> 670327 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26 (1435691316833943552)]} 0 4
[junit4:junit4] 2> 670330 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27 (1435691316841283584)]} 0 0
[junit4:junit4] 2> 670337 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435691316844429312)]} 0 1
[junit4:junit4] 2> 670337 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27 (1435691316844429312)]} 0 4
[junit4:junit4] 2> 670340 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28 (1435691316851769344)]} 0 0
[junit4:junit4] 2> 670349 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435691316858060800)]} 0 0
[junit4:junit4] 2> 670350 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[28 (1435691316858060800)]} 0 4
[junit4:junit4] 2> 670351 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28]} 0 8
[junit4:junit4] 2> 670354 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1435691316866449408)]} 0 0
[junit4:junit4] 2> 670361 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435691316869595136)]} 0 1
[junit4:junit4] 2> 670361 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1435691316869595136)]} 0 4
[junit4:junit4] 2> 670364 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1435691316876935168)]} 0 0
[junit4:junit4] 2> 670371 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435691316880080896)]} 0 1
[junit4:junit4] 2> 670371 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1435691316880080896)]} 0 4
[junit4:junit4] 2> 670375 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1435691316887420928)]} 0 1
[junit4:junit4] 2> 670384 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435691316893712384)]} 0 1
[junit4:junit4] 2> 670384 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[31 (1435691316893712384)]} 0 4
[junit4:junit4] 2> 670385 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31]} 0 8
[junit4:junit4] 2> 670388 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1435691316902100992)]} 0 0
[junit4:junit4] 2> 670395 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435691316905246720)]} 0 1
[junit4:junit4] 2> 670395 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1435691316905246720)]} 0 4
[junit4:junit4] 2> 670399 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1435691316912586752)]} 0 0
[junit4:junit4] 2> 670404 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435691316915732480)]} 0 0
[junit4:junit4] 2> 670405 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1435691316915732480)]} 0 4
[junit4:junit4] 2> 670409 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34 (1435691316923072512)]} 0 1
[junit4:junit4] 2> 670418 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1435691316929363968)]} 0 1
[junit4:junit4] 2> 670418 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[34 (1435691316929363968)]} 0 4
[junit4:junit4] 2> 670419 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34]} 0 8
[junit4:junit4] 2> 670422 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35 (1435691316937752576)]} 0 0
[junit4:junit4] 2> 670428 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1435691316940898304)]} 0 0
[junit4:junit4] 2> 670429 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35 (1435691316940898304)]} 0 4
[junit4:junit4] 2> 670432 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36 (1435691316948238336)]} 0 0
[junit4:junit4] 2> 670439 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1435691316951384064)]} 0 1
[junit4:junit4] 2> 670439 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36 (1435691316951384064)]} 0 4
[junit4:junit4] 2> 670442 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37 (1435691316958724096)]} 0 0
[junit4:junit4] 2> 670452 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1435691316965015552)]} 0 1
[junit4:junit4] 2> 670452 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[37 (1435691316965015552)]} 0 4
[junit4:junit4] 2> 670453 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37]} 0 8
[junit4:junit4] 2> 670456 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38 (1435691316973404160)]} 0 0
[junit4:junit4] 2> 670463 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1435691316976549888)]} 0 1
[junit4:junit4] 2> 670463 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38 (1435691316976549888)]} 0 4
[junit4:junit4] 2> 670466 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39 (1435691316983889920)]} 0 0
[junit4:junit4] 2> 670476 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1435691316990181376)]} 0 1
[junit4:junit4] 2> 670476 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[39 (1435691316990181376)]} 0 4
[junit4:junit4] 2> 670477 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39]} 0 8
[junit4:junit4] 2> 670480 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1435691316998569984)]} 0 0
[junit4:junit4] 2> 670490 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1435691317004861440)]} 0 1
[junit4:junit4] 2> 670490 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[40 (1435691317004861440)]} 0 4
[junit4:junit4] 2> 670491 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40]} 0 8
[junit4:junit4] 2> 670494 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1435691317013250048)]} 0 0
[junit4:junit4] 2> 670501 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1435691317016395776)]} 0 1
[junit4:junit4] 2> 670501 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1435691317016395776)]} 0 4
[junit4:junit4] 2> 670505 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1435691317023735808)]} 0 1
[junit4:junit4] 2> 670511 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1435691317026881536)]} 0 1
[junit4:junit4] 2> 670511 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1435691317026881536)]} 0 4
[junit4:junit4] 2> 670514 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1435691317034221568)]} 0 0
[junit4:junit4] 2> 670521 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1435691317037367296)]} 0 1
[junit4:junit4] 2> 670521 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1435691317037367296)]} 0 4
[junit4:junit4] 2> 670524 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1435691317044707328)]} 0 0
[junit4:junit4] 2> 670531 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1435691317047853056)]} 0 1
[junit4:junit4] 2> 670531 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1435691317047853056)]} 0 4
[junit4:junit4] 2> 670534 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45 (1435691317055193088)]} 0 0
[junit4:junit4] 2> 670541 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1435691317058338816)]} 0 1
[junit4:junit4] 2> 670541 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45 (1435691317058338816)]} 0 4
[junit4:junit4] 2> 670544 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46 (1435691317065678848)]} 0 0
[junit4:junit4] 2> 670554 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1435691317071970304)]} 0 1
[junit4:junit4] 2> 670554 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[46 (1435691317071970304)]} 0 4
[junit4:junit4] 2> 670555 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46]} 0 8
[junit4:junit4] 2> 670558 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47 (1435691317080358912)]} 0 0
[junit4:junit4] 2> 670568 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1435691317086650368)]} 0 1
[junit4:junit4] 2> 670568 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[47 (1435691317086650368)]} 0 4
[junit4:junit4] 2> 670569 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47]} 0 8
[junit4:junit4] 2> 670572 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48 (1435691317095038976)]} 0 0
[junit4:junit4] 2> 670582 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1435691317101330432)]} 0 1
[junit4:junit4] 2> 670582 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[48 (1435691317101330432)]} 0 4
[junit4:junit4] 2> 670583 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48]} 0 8
[junit4:junit4] 2> 670586 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49 (1435691317109719040)]} 0 0
[junit4:junit4] 2> 670593 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1435691317112864768)]} 0 1
[junit4:junit4] 2> 670593 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49 (1435691317112864768)]} 0 4
[junit4:junit4] 2> 670596 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1435691317120204800)]} 0 0
[junit4:junit4] 2> 670603 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1435691317123350528)]} 0 1
[junit4:junit4] 2> 670603 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1435691317123350528)]} 0 4
[junit4:junit4] 2> 670607 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51 (1435691317130690560)]} 0 1
[junit4:junit4] 2> 670616 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1435691317136982016)]} 0 1
[junit4:junit4] 2> 670616 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[51 (1435691317136982016)]} 0 4
[junit4:junit4] 2> 670617 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51]} 0 8
[junit4:junit4] 2> 670620 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52 (1435691317145370624)]} 0 0
[junit4:junit4] 2> 670627 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1435691317148516352)]} 0 1
[junit4:junit4] 2> 670627 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52 (1435691317148516352)]} 0 4
[junit4:junit4] 2> 670630 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53 (1435691317155856384)]} 0 0
[junit4:junit4] 2> 670637 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1435691317159002112)]} 0 1
[junit4:junit4] 2> 670637 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53 (1435691317159002112)]} 0 4
[junit4:junit4] 2> 670640 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54 (1435691317166342144)]} 0 0
[junit4:junit4] 2> 670650 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1435691317172633600)]} 0 1
[junit4:junit4] 2> 670650 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[54 (1435691317172633600)]} 0 4
[junit4:junit4] 2> 670651 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54]} 0 8
[junit4:junit4] 2> 670654 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55 (1435691317181022208)]} 0 0
[junit4:junit4] 2> 670664 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1435691317187313664)]} 0 1
[junit4:junit4] 2> 670664 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[55 (1435691317187313664)]} 0 4
[junit4:junit4] 2> 670665 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55]} 0 8
[junit4:junit4] 2> 670669 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1435691317195702272)]} 0 1
[junit4:junit4] 2> 670676 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1435691317199896576)]} 0 1
[junit4:junit4] 2> 670676 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1435691317199896576)]} 0 4
[junit4:junit4] 2> 670680 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57 (1435691317207236608)]} 0 1
[junit4:junit4] 2> 670689 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1435691317213528064)]} 0 1
[junit4:junit4] 2> 670690 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[57 (1435691317213528064)]} 0 5
[junit4:junit4] 2> 670690 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57]} 0 8
[junit4:junit4] 2> 670694 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58 (1435691317221916672)]} 0 1
[junit4:junit4] 2> 670704 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1435691317229256704)]} 0 1
[junit4:junit4] 2> 670705 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[58 (1435691317229256704)]} 0 5
[junit4:junit4] 2> 670706 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58]} 0 9
[junit4:junit4] 2> 670710 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59 (1435691317238693888)]} 0 1
[junit4:junit4] 2> 670718 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1435691317244985344)]} 0 0
[junit4:junit4] 2> 670719 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[59 (1435691317244985344)]} 0 4
[junit4:junit4] 2> 670720 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59]} 0 8
[junit4:junit4] 2> 670723 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60 (1435691317253373952)]} 0 0
[junit4:junit4] 2> 670730 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1435691317256519680)]} 0 1
[junit4:junit4] 2> 670730 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60 (1435691317256519680)]} 0 4
[junit4:junit4] 2> 670734 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61 (1435691317263859712)]} 0 1
[junit4:junit4] 2> 670739 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1435691317267005440)]} 0 0
[junit4:junit4] 2> 670740 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61 (1435691317267005440)]} 0 4
[junit4:junit4] 2> 670744 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62 (1435691317274345472)]} 0 0
[junit4:junit4] 2> 670750 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1435691317277491200)]} 0 0
[junit4:junit4] 2> 670750 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62 (1435691317277491200)]} 0 4
[junit4:junit4] 2> 670754 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63 (1435691317284831232)]} 0 0
[junit4:junit4] 2> 670760 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1435691317287976960)]} 0 1
[junit4:junit4] 2> 670760 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63 (1435691317287976960)]} 0 4
[junit4:junit4] 2> 670764 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64 (1435691317295316992)]} 0 1
[junit4:junit4] 2> 670771 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1435691317299511296)]} 0 1
[junit4:junit4] 2> 670771 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64 (1435691317299511296)]} 0 4
[junit4:junit4] 2> 670774 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65 (1435691317306851328)]} 0 0
[junit4:junit4] 2> 670784 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[65 (1435691317313142784)]} 0 1
[junit4:junit4] 2> 670784 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[65 (1435691317313142784)]} 0 4
[junit4:junit4] 2> 670785 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65]} 0 8
[junit4:junit4] 2> 670789 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66 (1435691317321531392)]} 0 1
[junit4:junit4] 2> 670799 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[66 (1435691317328871424)]} 0 0
[junit4:junit4] 2> 670799 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[66 (1435691317328871424)]} 0 4
[junit4:junit4] 2> 670800 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66]} 0 8
[junit4:junit4] 2> 670804 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[67 (1435691317337260032)]} 0 1
[junit4:junit4] 2> 670813 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[67 (1435691317343551488)]} 0 1
[junit4:junit4] 2> 670813 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[67 (1435691317343551488)]} 0 4
[junit4:junit4] 2> 670814 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[67]} 0 8
[junit4:junit4] 2> 670818 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[68 (1435691317351940096)]} 0 1
[junit4:junit4] 2> 670825 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[68 (1435691317356134400)]} 0 1
[junit4:junit4] 2> 670825 T1920 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[68 (1435691317356134400)]} 0 4
[junit4:junit4] 2> 670826 T1904 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[68]} 0 6
[junit4:junit4] 2> 670830 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[69 (1435691317364523008)]} 0 1
[junit4:junit4] 2> 670836 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[69 (1435691317367668736)]} 0 1
[junit4:junit4] 2> 670836 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[69 (1435691317367668736)]} 0 4
[junit4:junit4] 2> 670839 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[70 (1435691317375008768)]} 0 0
[junit4:junit4] 2> 670849 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[70 (1435691317381300224)]} 0 1
[junit4:junit4] 2> 670849 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[70 (1435691317381300224)]} 0 4
[junit4:junit4] 2> 670850 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[70]} 0 8
[junit4:junit4] 2> 670853 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[71 (1435691317389688832)]} 0 0
[junit4:junit4] 2> 670860 T1947 C254 P49943 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[71 (1435691317392834560)]} 0 1
[junit4:junit4] 2> 670860 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[71 (1435691317392834560)]} 0 4
[junit4:junit4] 2> 670863 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[72 (1435691317400174592)]} 0 0
[junit4:junit4] 2> 670873 T1932 C255 P35578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25762/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[72 (1435691317406466048)]} 0 1
[junit4:junit4] 2> 670873 T1902 C256 P25762 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:25767/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[72 (1435691317406466048)]} 0 4
[junit4:junit4] 2> 670874 T1918 C257 P25767 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[72]} 0 8
[junit4:junit4] 2> 670878 T1878 C258 P25754 oasup.LogUpdateProcessor.finish [collection1] webapp= pa
[...truncated too long message...]
4892 T1940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 874893 T1940 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 874893 T1940 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 874893 T1866 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 874894 T1957 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 874896 T1957 oasc.Overseer.start Overseer (id=89730705574920204-127.0.0.1:49943_-n_0000000004) starting
[junit4:junit4] 2> 874900 T2042 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 874900 T1957 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 874900 T1957 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 874901 T2041 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 874946 T1866 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 49943
[junit4:junit4] 2> 874946 T1866 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1000646797
[junit4:junit4] 2> 875949 T1866 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 875949 T1866 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 875952 T1866 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1ac864a3
[junit4:junit4] 2> 875954 T1866 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=634,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 875955 T1866 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 875955 T1866 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 875956 T1866 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 875958 T1866 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 875959 T1866 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 875959 T1866 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index;done=false>>]
[junit4:junit4] 2> 875960 T1866 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4/index
[junit4:junit4] 2> 875960 T1866 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4;done=false>>]
[junit4:junit4] 2> 875961 T1866 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789/jetty4
[junit4:junit4] 2> 875962 T2041 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89730705574920204-127.0.0.1:49943_-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 875964 T1866 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 876034 T1866 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 876036 T1866 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:25751 25751
[junit4:junit4] 2> 876193 T1866 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 25754
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369181908789 FAILED !!!!!
[junit4:junit4] 2> 876195 T1866 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 876195 T1866 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:25751 25751
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=ED402A89370D4B6F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_SY -Dtests.timezone=America/Miquelon -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 232s J0 | ChaosMonkeyShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:25762 returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([ED402A89370D4B6F:6CA6A49140522B53]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 876223 T1866 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 232274 T1865 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> 877264 T1957 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 877264 T1957 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 877264 T1957 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene3x, sim=DefaultSimilarity, locale=ar_SY, timezone=America/Miquelon
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=141797816,total=456130560
[junit4:junit4] 2> NOTE: All tests run in this JVM: [XsltUpdateRequestHandlerTest, TestFieldResource, LeaderElectionTest, TestBM25SimilarityFactory, TestStressVersions, TestUtils, ChaosMonkeySafeLeaderTest, TestLazyCores, TestShardHandlerFactory, MinimalSchemaTest, OverseerTest, SolrCoreCheckLockOnStartupTest, FastVectorHighlighterTest, TestFiltering, TestFuzzyAnalyzedSuggestions, AlternateDirectoryTest, DirectSolrSpellCheckerTest, TestQuerySenderListener, TestSolrCoreProperties, LoggingHandlerTest, LegacyHTMLStripCharFilterTest, HighlighterTest, ExternalFileFieldSortTest, BasicZkTest, TestMaxScoreQueryParser, SolrCmdDistributorTest, TestFieldCollectionResource, TestFunctionQuery, DocumentBuilderTest, FieldMutatingUpdateProcessorTest, DefaultValueUpdateProcessorTest, DistributedTermsComponentTest, TestSchemaResource, TestFieldTypeCollectionResource, TestExtendedDismaxParser, TestIndexingPerformance, DateMathParserTest, TestFastOutputStream, CurrencyFieldOpenExchangeTest, CircularListTest, StatsComponentTest, TestLMDirichletSimilarityFactory, DocValuesTest, RegexBoostProcessorTest, SolrRequestParserTest, CopyFieldTest, SynonymTokenizerTest, MultiTermTest, TestSuggestSpellingConverter, TestPHPSerializedResponseWriter, TestBinaryField, TestSurroundQueryParser, TestSolrDeletionPolicy1, TestFastWriter, TestDFRSimilarityFactory, RecoveryZkTest, CoreContainerCoreInitFailuresTest, TestUniqueKeyFieldResource, TestXIncludeConfig, PrimitiveFieldTypeTest, TestBadConfig, HardAutoCommitTest, CacheHeaderTest, ResourceLoaderTest, TestPhraseSuggestions, SortByFunctionTest, TermsComponentTest, OverseerCollectionProcessorTest, TestSystemIdResolver, TestSolrQueryParserDefaultOperatorResource, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 233.56s, 1 test, 1 error <<< FAILURES!
[...truncated 527 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:386: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:366: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 14 ignored (8 assumptions)
Total time: 52 minutes 51 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1276 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1276/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:49684/ce/ib returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:49684/ce/ib returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([79BD7E6824107870:F85BF070534F184C]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9594 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 522865 T1653 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ce/ib
[junit4:junit4] 2> 522870 T1653 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1369276996286
[junit4:junit4] 2> 522871 T1653 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 522872 T1654 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 522973 T1653 oasc.ZkTestServer.run start zk server on port:49672
[junit4:junit4] 2> 522973 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 522977 T1660 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64c8bbc6 name:ZooKeeperConnection Watcher:127.0.0.1:49672 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 522977 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 522978 T1653 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 522989 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 522991 T1662 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36ea1387 name:ZooKeeperConnection Watcher:127.0.0.1:49672/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 522992 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 522992 T1653 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 523002 T1653 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 523005 T1653 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 523007 T1653 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 523016 T1653 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 523017 T1653 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 523021 T1653 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 523022 T1653 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 523125 T1653 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 523126 T1653 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 523134 T1653 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 523135 T1653 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 523138 T1653 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 523138 T1653 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 523141 T1653 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 523142 T1653 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 523145 T1653 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 523145 T1653 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 523148 T1653 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 523149 T1653 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 523151 T1653 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 523152 T1653 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 523431 T1653 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 523436 T1653 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49675
[junit4:junit4] 2> 523437 T1653 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 523437 T1653 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 523438 T1653 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369276996578
[junit4:junit4] 2> 523438 T1653 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369276996578/solr.xml
[junit4:junit4] 2> 523439 T1653 oasc.CoreContainer.<init> New CoreContainer 1282741070
[junit4:junit4] 2> 523439 T1653 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369276996578/'
[junit4:junit4] 2> 523440 T1653 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369276996578/'
[junit4:junit4] 2> 523568 T1653 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 523569 T1653 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 523569 T1653 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 523570 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 523570 T1653 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 523571 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 523571 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 523572 T1653 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 523572 T1653 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 523573 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 523590 T1653 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 523591 T1653 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49672/solr
[junit4:junit4] 2> 523591 T1653 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 523592 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 523595 T1673 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68383b76 name:ZooKeeperConnection Watcher:127.0.0.1:49672 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 523595 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 523598 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 523609 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 523611 T1675 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ecd4abc name:ZooKeeperConnection Watcher:127.0.0.1:49672/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 523611 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 523613 T1653 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 523623 T1653 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 523630 T1653 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 523632 T1653 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49675_ce%2Fib
[junit4:junit4] 2> 523634 T1653 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49675_ce%2Fib
[junit4:junit4] 2> 523642 T1653 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 523658 T1653 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 523661 T1653 oasc.Overseer.start Overseer (id=89736937228926979-127.0.0.1:49675_ce%2Fib-n_0000000000) starting
[junit4:junit4] 2> 523673 T1653 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 523685 T1677 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 523686 T1653 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 523688 T1653 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 523690 T1653 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 523692 T1676 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 523696 T1678 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369276996578/collection1
[junit4:junit4] 2> 523696 T1678 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 523697 T1678 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 523697 T1678 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 523699 T1678 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369276996578/collection1/'
[junit4:junit4] 2> 523700 T1678 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369276996578/collection1/lib/README' to classloader
[junit4:junit4] 2> 523701 T1678 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369276996578/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 523751 T1678 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 523828 T1678 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 523929 T1678 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 523935 T1678 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 524510 T1678 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 524514 T1678 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 524517 T1678 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 524522 T1678 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 524546 T1678 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 524547 T1678 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369276996578/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/control/data/
[junit4:junit4] 2> 524547 T1678 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@637c72aa
[junit4:junit4] 2> 524548 T1678 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 524548 T1678 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/control/data
[junit4:junit4] 2> 524549 T1678 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/control/data/index/
[junit4:junit4] 2> 524549 T1678 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 524549 T1678 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/control/data/index
[junit4:junit4] 2> 524554 T1678 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a06d16e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a3cb03d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 524554 T1678 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 524557 T1678 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 524557 T1678 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 524558 T1678 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 524559 T1678 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 524559 T1678 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 524559 T1678 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 524560 T1678 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 524560 T1678 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 524560 T1678 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 524576 T1678 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 524582 T1678 oass.SolrIndexSearcher.<init> Opening Searcher@5e0f5f7c main
[junit4:junit4] 2> 524583 T1678 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/control/data/tlog
[junit4:junit4] 2> 524584 T1678 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 524584 T1678 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 524587 T1679 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5e0f5f7c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 524589 T1678 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 524589 T1678 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 525195 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 525196 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49675_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49675/ce/ib"}
[junit4:junit4] 2> 525196 T1676 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 525196 T1676 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 525213 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 525592 T1678 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 525592 T1678 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49675/ce/ib collection:control_collection shard:shard1
[junit4:junit4] 2> 525593 T1678 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 525609 T1678 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 525619 T1678 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 525619 T1678 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 525619 T1678 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49675/ce/ib/collection1/
[junit4:junit4] 2> 525619 T1678 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 525620 T1678 oasc.SyncStrategy.syncToMe http://127.0.0.1:49675/ce/ib/collection1/ has no replicas
[junit4:junit4] 2> 525620 T1678 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49675/ce/ib/collection1/
[junit4:junit4] 2> 525620 T1678 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 526717 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 526758 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 526808 T1678 oasc.ZkController.register We are http://127.0.0.1:49675/ce/ib/collection1/ and leader is http://127.0.0.1:49675/ce/ib/collection1/
[junit4:junit4] 2> 526808 T1678 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49675/ce/ib
[junit4:junit4] 2> 526808 T1678 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 526808 T1678 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 526809 T1678 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 526811 T1678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 526812 T1653 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 526812 T1653 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 526813 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 526830 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 526832 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 526834 T1682 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6bd1d900 name:ZooKeeperConnection Watcher:127.0.0.1:49672/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 526834 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 526835 T1653 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 526837 T1653 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 527107 T1653 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 527110 T1653 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49684
[junit4:junit4] 2> 527111 T1653 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 527112 T1653 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 527112 T1653 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369277000253
[junit4:junit4] 2> 527113 T1653 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369277000253/solr.xml
[junit4:junit4] 2> 527113 T1653 oasc.CoreContainer.<init> New CoreContainer 1442388385
[junit4:junit4] 2> 527114 T1653 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369277000253/'
[junit4:junit4] 2> 527114 T1653 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369277000253/'
[junit4:junit4] 2> 527240 T1653 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 527241 T1653 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 527241 T1653 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 527242 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 527242 T1653 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 527243 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 527243 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 527244 T1653 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 527244 T1653 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 527245 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 527261 T1653 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 527262 T1653 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49672/solr
[junit4:junit4] 2> 527263 T1653 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 527264 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 527266 T1693 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7cddfd0d name:ZooKeeperConnection Watcher:127.0.0.1:49672 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 527267 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 527277 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 527289 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 527291 T1695 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a2bb9b4 name:ZooKeeperConnection Watcher:127.0.0.1:49672/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 527291 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 527299 T1653 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 528271 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 528272 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49675_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49675/ce/ib"}
[junit4:junit4] 2> 528302 T1653 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49684_ce%2Fib
[junit4:junit4] 2> 528313 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 528313 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 528313 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 528314 T1653 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49684_ce%2Fib
[junit4:junit4] 2> 528325 T1682 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 528326 T1675 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 528326 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 528325 T1695 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 528326 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 528326 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 528333 T1696 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369277000253/collection1
[junit4:junit4] 2> 528333 T1696 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 528334 T1696 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 528334 T1696 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 528336 T1696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369277000253/collection1/'
[junit4:junit4] 2> 528337 T1696 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369277000253/collection1/lib/README' to classloader
[junit4:junit4] 2> 528338 T1696 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369277000253/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 528388 T1696 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 528447 T1696 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 528548 T1696 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 528554 T1696 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 529095 T1696 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 529098 T1696 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 529100 T1696 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 529103 T1696 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 529124 T1696 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 529124 T1696 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369277000253/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty1/
[junit4:junit4] 2> 529124 T1696 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@637c72aa
[junit4:junit4] 2> 529125 T1696 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 529125 T1696 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty1
[junit4:junit4] 2> 529125 T1696 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty1/index/
[junit4:junit4] 2> 529126 T1696 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 529126 T1696 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty1/index
[junit4:junit4] 2> 529129 T1696 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@580cd615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e428d9d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 529129 T1696 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 529131 T1696 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 529132 T1696 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 529132 T1696 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 529132 T1696 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 529133 T1696 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 529133 T1696 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 529133 T1696 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 529134 T1696 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 529134 T1696 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 529145 T1696 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 529149 T1696 oass.SolrIndexSearcher.<init> Opening Searcher@7acae9f3 main
[junit4:junit4] 2> 529150 T1696 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty1/tlog
[junit4:junit4] 2> 529151 T1696 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 529151 T1696 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 529154 T1697 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7acae9f3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 529155 T1696 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 529155 T1696 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 529818 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 529819 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49684_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49684/ce/ib"}
[junit4:junit4] 2> 529819 T1676 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 529819 T1676 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 529878 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 529878 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 529878 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 530184 T1696 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 530184 T1696 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49684/ce/ib collection:collection1 shard:shard1
[junit4:junit4] 2> 530185 T1696 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 530209 T1696 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 530226 T1696 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 530226 T1696 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 530227 T1696 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49684/ce/ib/collection1/
[junit4:junit4] 2> 530227 T1696 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 530227 T1696 oasc.SyncStrategy.syncToMe http://127.0.0.1:49684/ce/ib/collection1/ has no replicas
[junit4:junit4] 2> 530227 T1696 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49684/ce/ib/collection1/
[junit4:junit4] 2> 530228 T1696 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 531382 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 531409 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 531409 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 531409 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 531415 T1696 oasc.ZkController.register We are http://127.0.0.1:49684/ce/ib/collection1/ and leader is http://127.0.0.1:49684/ce/ib/collection1/
[junit4:junit4] 2> 531415 T1696 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49684/ce/ib
[junit4:junit4] 2> 531415 T1696 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 531415 T1696 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 531416 T1696 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 531417 T1696 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 531418 T1653 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 531419 T1653 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 531420 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 531706 T1653 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 531709 T1653 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49688
[junit4:junit4] 2> 531710 T1653 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 531710 T1653 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 531711 T1653 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369277004852
[junit4:junit4] 2> 531711 T1653 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369277004852/solr.xml
[junit4:junit4] 2> 531712 T1653 oasc.CoreContainer.<init> New CoreContainer 1034918296
[junit4:junit4] 2> 531713 T1653 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369277004852/'
[junit4:junit4] 2> 531713 T1653 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369277004852/'
[junit4:junit4] 2> 531841 T1653 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 531842 T1653 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 531843 T1653 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 531843 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 531844 T1653 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 531844 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 531845 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 531845 T1653 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 531846 T1653 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 531846 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 531863 T1653 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 531864 T1653 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49672/solr
[junit4:junit4] 2> 531864 T1653 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 531865 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 531868 T1709 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54789caf name:ZooKeeperConnection Watcher:127.0.0.1:49672 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 531869 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 531879 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 531891 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 531893 T1711 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b140551 name:ZooKeeperConnection Watcher:127.0.0.1:49672/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 531893 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 531902 T1653 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 532905 T1653 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49688_ce%2Fib
[junit4:junit4] 2> 532907 T1653 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49688_ce%2Fib
[junit4:junit4] 2> 532909 T1675 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 532910 T1682 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 532910 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 532910 T1695 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 532910 T1711 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 532911 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 532910 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 532921 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 532921 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49684_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49684/ce/ib"}
[junit4:junit4] 2> 532925 T1712 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369277004852/collection1
[junit4:junit4] 2> 532925 T1712 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 532930 T1712 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 532930 T1712 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 532931 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 532931 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 532931 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 532931 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 532932 T1712 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369277004852/collection1/'
[junit4:junit4] 2> 532934 T1712 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369277004852/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 532934 T1712 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369277004852/collection1/lib/README' to classloader
[junit4:junit4] 2> 532985 T1712 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 533043 T1712 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 533145 T1712 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 533151 T1712 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 533713 T1712 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 533717 T1712 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 533720 T1712 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 533725 T1712 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 533749 T1712 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 533749 T1712 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369277004852/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty2/
[junit4:junit4] 2> 533749 T1712 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@637c72aa
[junit4:junit4] 2> 533750 T1712 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 533751 T1712 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty2
[junit4:junit4] 2> 533751 T1712 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty2/index/
[junit4:junit4] 2> 533751 T1712 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 533752 T1712 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty2/index
[junit4:junit4] 2> 533756 T1712 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4e50b5d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@747480c5),segFN=segments_1,generation=1}
[junit4:junit4] 2> 533756 T1712 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 533759 T1712 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 533759 T1712 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 533760 T1712 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 533761 T1712 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 533761 T1712 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 533762 T1712 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 533762 T1712 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 533763 T1712 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 533763 T1712 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 533779 T1712 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 533787 T1712 oass.SolrIndexSearcher.<init> Opening Searcher@50d41350 main
[junit4:junit4] 2> 533787 T1712 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty2/tlog
[junit4:junit4] 2> 533788 T1712 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 533788 T1712 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 533793 T1713 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@50d41350 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 533795 T1712 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 533795 T1712 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 534435 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 534436 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49688_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49688/ce/ib"}
[junit4:junit4] 2> 534436 T1676 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 534436 T1676 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 534453 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 534453 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 534453 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 534453 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 534798 T1712 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 534798 T1712 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49688/ce/ib collection:collection1 shard:shard2
[junit4:junit4] 2> 534800 T1712 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 534881 T1712 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 534912 T1712 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 534912 T1712 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 534913 T1712 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49688/ce/ib/collection1/
[junit4:junit4] 2> 534913 T1712 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 534913 T1712 oasc.SyncStrategy.syncToMe http://127.0.0.1:49688/ce/ib/collection1/ has no replicas
[junit4:junit4] 2> 534913 T1712 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49688/ce/ib/collection1/
[junit4:junit4] 2> 534914 T1712 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 535957 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 535981 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 535981 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 535981 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 535981 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 536027 T1712 oasc.ZkController.register We are http://127.0.0.1:49688/ce/ib/collection1/ and leader is http://127.0.0.1:49688/ce/ib/collection1/
[junit4:junit4] 2> 536027 T1712 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49688/ce/ib
[junit4:junit4] 2> 536027 T1712 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 536027 T1712 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 536028 T1712 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 536030 T1712 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 536031 T1653 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 536032 T1653 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 536032 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 536313 T1653 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 536316 T1653 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49692
[junit4:junit4] 2> 536317 T1653 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 536318 T1653 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 536318 T1653 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369277009464
[junit4:junit4] 2> 536319 T1653 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369277009464/solr.xml
[junit4:junit4] 2> 536319 T1653 oasc.CoreContainer.<init> New CoreContainer 1246866915
[junit4:junit4] 2> 536320 T1653 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369277009464/'
[junit4:junit4] 2> 536320 T1653 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369277009464/'
[junit4:junit4] 2> 536446 T1653 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 536447 T1653 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 536447 T1653 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 536448 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 536448 T1653 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 536449 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 536449 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 536450 T1653 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 536450 T1653 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 536451 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 536467 T1653 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 536468 T1653 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49672/solr
[junit4:junit4] 2> 536469 T1653 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 536470 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 536473 T1725 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6470d620 name:ZooKeeperConnection Watcher:127.0.0.1:49672 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 536473 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 536489 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 536501 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 536503 T1727 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f67101a name:ZooKeeperConnection Watcher:127.0.0.1:49672/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 536503 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 536514 T1653 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 537496 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 537497 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49688_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49688/ce/ib"}
[junit4:junit4] 2> 537510 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 537510 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 537510 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 537510 T1727 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 537510 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 537517 T1653 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49692_ce%2Fib
[junit4:junit4] 2> 537519 T1653 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49692_ce%2Fib
[junit4:junit4] 2> 537521 T1727 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 537521 T1695 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 537521 T1682 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 537521 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 537521 T1711 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 537521 T1675 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 537522 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 537522 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 537522 T1727 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 537522 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 537535 T1728 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369277009464/collection1
[junit4:junit4] 2> 537535 T1728 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 537536 T1728 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 537536 T1728 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 537538 T1728 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369277009464/collection1/'
[junit4:junit4] 2> 537539 T1728 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369277009464/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 537540 T1728 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369277009464/collection1/lib/README' to classloader
[junit4:junit4] 2> 537591 T1728 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 537651 T1728 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 537752 T1728 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 537758 T1728 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 538321 T1728 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 538325 T1728 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 538327 T1728 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 538332 T1728 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 538357 T1728 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 538357 T1728 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369277009464/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3/
[junit4:junit4] 2> 538357 T1728 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@637c72aa
[junit4:junit4] 2> 538358 T1728 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 538359 T1728 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3
[junit4:junit4] 2> 538359 T1728 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3/index/
[junit4:junit4] 2> 538359 T1728 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 538360 T1728 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3/index
[junit4:junit4] 2> 538364 T1728 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@471578f4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a99923b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 538364 T1728 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 538367 T1728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 538368 T1728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 538368 T1728 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 538369 T1728 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 538370 T1728 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 538370 T1728 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 538370 T1728 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 538371 T1728 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 538371 T1728 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 538388 T1728 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 538395 T1728 oass.SolrIndexSearcher.<init> Opening Searcher@2ea1a02a main
[junit4:junit4] 2> 538396 T1728 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3/tlog
[junit4:junit4] 2> 538397 T1728 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 538397 T1728 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 538401 T1729 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2ea1a02a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 538403 T1728 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 538404 T1728 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 539014 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 539015 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49692_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49692/ce/ib"}
[junit4:junit4] 2> 539015 T1676 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 539016 T1676 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 539029 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 539029 T1727 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 539029 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 539029 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 539029 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 539407 T1728 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 539407 T1728 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49692/ce/ib collection:collection1 shard:shard1
[junit4:junit4] 2> 539410 T1728 oasc.ZkController.register We are http://127.0.0.1:49692/ce/ib/collection1/ and leader is http://127.0.0.1:49684/ce/ib/collection1/
[junit4:junit4] 2> 539410 T1728 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49692/ce/ib
[junit4:junit4] 2> 539410 T1728 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 539411 T1728 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C773 name=collection1 org.apache.solr.core.SolrCore@142c9aea url=http://127.0.0.1:49692/ce/ib/collection1 node=127.0.0.1:49692_ce%2Fib C773_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:49692_ce%2Fib, base_url=http://127.0.0.1:49692/ce/ib}
[junit4:junit4] 2> 539411 T1730 C773 P49692 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 539411 T1728 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 539412 T1730 C773 P49692 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 539413 T1730 C773 P49692 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 539413 T1730 C773 P49692 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 539413 T1653 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 539414 T1653 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 539414 T1730 C773 P49692 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 539415 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 539436 T1685 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 539703 T1653 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 539706 T1653 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49696
[junit4:junit4] 2> 539707 T1653 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 539707 T1653 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 539708 T1653 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369277012849
[junit4:junit4] 2> 539708 T1653 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369277012849/solr.xml
[junit4:junit4] 2> 539709 T1653 oasc.CoreContainer.<init> New CoreContainer 539011038
[junit4:junit4] 2> 539709 T1653 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369277012849/'
[junit4:junit4] 2> 539710 T1653 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369277012849/'
[junit4:junit4] 2> 539838 T1653 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 539839 T1653 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 539840 T1653 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 539840 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 539841 T1653 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 539841 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 539841 T1653 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 539842 T1653 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 539842 T1653 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 539843 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 539862 T1653 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 539862 T1653 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49672/solr
[junit4:junit4] 2> 539863 T1653 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 539864 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 539868 T1742 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@687d566a name:ZooKeeperConnection Watcher:127.0.0.1:49672 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 539869 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 539894 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 539908 T1653 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 539910 T1744 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54e8ac20 name:ZooKeeperConnection Watcher:127.0.0.1:49672/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 539910 T1653 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 539938 T1653 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 540533 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 540534 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49692_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49692/ce/ib"}
[junit4:junit4] 2> 540549 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 540550 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 540550 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 540550 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 540550 T1727 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 540550 T1744 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 540941 T1653 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49696_ce%2Fib
[junit4:junit4] 2> 540943 T1653 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49696_ce%2Fib
[junit4:junit4] 2> 540951 T1744 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 540952 T1695 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 540952 T1675 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 540952 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 540952 T1711 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 540951 T1727 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 540952 T1682 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 540953 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 540952 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 540953 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 540954 T1744 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 540955 T1727 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 540960 T1745 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369277012849/collection1
[junit4:junit4] 2> 540960 T1745 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 540960 T1745 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 540961 T1745 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 540962 T1745 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369277012849/collection1/'
[junit4:junit4] 2> 540963 T1745 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369277012849/collection1/lib/README' to classloader
[junit4:junit4] 2> 540964 T1745 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369277012849/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 541015 T1745 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 541074 T1745 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 541175 T1745 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 541181 T1745 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 541438 T1685 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 541438 T1685 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:49692_ce%252Fib&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 541747 T1745 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 541751 T1745 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 541753 T1745 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 541759 T1745 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 541782 T1745 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 541782 T1745 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369277012849/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/
[junit4:junit4] 2> 541782 T1745 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@637c72aa
[junit4:junit4] 2> 541783 T1745 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 541784 T1745 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4
[junit4:junit4] 2> 541784 T1745 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index/
[junit4:junit4] 2> 541784 T1745 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 541785 T1745 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index
[junit4:junit4] 2> 541789 T1745 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@676b9033 lockFactory=org.apache.lucene.store.NativeFSLockFactory@71a992d1),segFN=segments_1,generation=1}
[junit4:junit4] 2> 541789 T1745 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 541792 T1745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 541793 T1745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 541793 T1745 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 541794 T1745 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 541795 T1745 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 541795 T1745 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 541795 T1745 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 541796 T1745 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 541796 T1745 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 541813 T1745 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 541821 T1745 oass.SolrIndexSearcher.<init> Opening Searcher@369d8b52 main
[junit4:junit4] 2> 541821 T1745 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/tlog
[junit4:junit4] 2> 541822 T1745 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 541823 T1745 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 541827 T1746 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@369d8b52 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 541829 T1745 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 541829 T1745 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 542054 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 542055 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49696_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49696/ce/ib"}
[junit4:junit4] 2> 542055 T1676 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 542055 T1676 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 542068 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 542068 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 542068 T1727 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 542068 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 542068 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 542068 T1744 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 542832 T1745 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 542832 T1745 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49696/ce/ib collection:collection1 shard:shard2
[junit4:junit4] 2> 542835 T1745 oasc.ZkController.register We are http://127.0.0.1:49696/ce/ib/collection1/ and leader is http://127.0.0.1:49688/ce/ib/collection1/
[junit4:junit4] 2> 542836 T1745 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49696/ce/ib
[junit4:junit4] 2> 542836 T1745 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 542836 T1745 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C774 name=collection1 org.apache.solr.core.SolrCore@35368958 url=http://127.0.0.1:49696/ce/ib/collection1 node=127.0.0.1:49696_ce%2Fib C774_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:49696_ce%2Fib, base_url=http://127.0.0.1:49696/ce/ib}
[junit4:junit4] 2> 542836 T1747 C774 P49696 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 542837 T1745 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 542837 T1747 C774 P49696 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 542838 T1747 C774 P49696 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 542838 T1747 C774 P49696 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 542839 T1653 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 542839 T1653 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 542839 T1747 C774 P49696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 542840 T1653 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 542865 T1653 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 542866 T1701 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 542866 T1653 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 542867 T1653 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 542867 T1653 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C775 name=collection1 org.apache.solr.core.SolrCore@142c9aea url=http://127.0.0.1:49692/ce/ib/collection1 node=127.0.0.1:49692_ce%2Fib C775_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:49692_ce%2Fib, base_url=http://127.0.0.1:49692/ce/ib}
[junit4:junit4] 2> 543440 T1730 C775 P49692 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49684/ce/ib/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 543440 T1730 C775 P49692 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:49692/ce/ib START replicas=[http://127.0.0.1:49684/ce/ib/collection1/] nUpdates=100
[junit4:junit4] 2> 543441 T1730 C775 P49692 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 543441 T1730 C775 P49692 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 543441 T1730 C775 P49692 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 543442 T1730 C775 P49692 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 543442 T1730 C775 P49692 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 543442 T1730 C775 P49692 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49684/ce/ib/collection1/. core=collection1
[junit4:junit4] 2> 543443 T1730 C775 P49692 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C776 name=collection1 org.apache.solr.core.SolrCore@594713c8 url=http://127.0.0.1:49684/ce/ib/collection1 node=127.0.0.1:49684_ce%2Fib C776_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49684_ce%2Fib, base_url=http://127.0.0.1:49684/ce/ib, leader=true}
[junit4:junit4] 2> 543450 T1686 C776 P49684 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 543456 T1687 C776 P49684 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 543458 T1687 C776 P49684 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@580cd615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e428d9d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 543459 T1687 C776 P49684 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 543460 T1687 C776 P49684 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@580cd615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e428d9d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@580cd615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e428d9d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 543460 T1687 C776 P49684 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 543461 T1687 C776 P49684 oass.SolrIndexSearcher.<init> Opening Searcher@133041d6 realtime
[junit4:junit4] 2> 543461 T1687 C776 P49684 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 543462 T1687 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 543463 T1730 C775 P49692 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 543463 T1730 C775 P49692 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 543466 T1688 C776 P49684 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 543466 T1688 C776 P49684 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 543467 T1730 C775 P49692 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 543467 T1730 C775 P49692 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 543468 T1730 C775 P49692 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 543470 T1688 C776 P49684 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 543471 T1730 C775 P49692 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 543472 T1730 C775 P49692 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3/index.20130522224336886
[junit4:junit4] 2> 543472 T1730 C775 P49692 oash.SnapPuller.fetchLatestIndex Starting download to BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3f92990c lockFactory=org.apache.lucene.store.NativeFSLockFactory@79b4f764) fullCopy=false
[junit4:junit4] 2> 543475 T1688 C776 P49684 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 543477 T1730 C775 P49692 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 543478 T1730 C775 P49692 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 543478 T1730 C775 P49692 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 543480 T1730 C775 P49692 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@471578f4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a99923b),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@471578f4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a99923b),segFN=segments_2,generation=2}
[junit4:junit4] 2> 543481 T1730 C775 P49692 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 543481 T1730 C775 P49692 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 543481 T1730 C775 P49692 oass.SolrIndexSearcher.<init> Opening Searcher@33ca1bc6 main
[junit4:junit4] 2> 543482 T1729 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33ca1bc6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 543483 T1730 C775 P49692 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3/index.20130522224336886 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3/index.20130522224336886;done=true>>]
[junit4:junit4] 2> 543483 T1730 C775 P49692 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3/index.20130522224336886
[junit4:junit4] 2> 543483 T1730 C775 P49692 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty3/index.20130522224336886
[junit4:junit4] 2> 543484 T1730 C775 P49692 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 543484 T1730 C775 P49692 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 543484 T1730 C775 P49692 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 543484 T1730 C775 P49692 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 543511 T1730 C775 P49692 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 543572 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 543573 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49696_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49696/ce/ib"}
[junit4:junit4] 2> 543576 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49692_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49692/ce/ib"}
[junit4:junit4] 2> 543589 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 543589 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 543589 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 543589 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 543589 T1744 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 543589 T1727 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 543867 T1701 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 543867 T1701 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:49696_ce%252Fib&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 543869 T1653 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 544871 T1653 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C774_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:49696_ce%2Fib, base_url=http://127.0.0.1:49696/ce/ib}
[junit4:junit4] 2> 545869 T1747 C774 P49696 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:49688/ce/ib/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 545869 T1747 C774 P49696 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:49696/ce/ib START replicas=[http://127.0.0.1:49688/ce/ib/collection1/] nUpdates=100
[junit4:junit4] 2> 545870 T1747 C774 P49696 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 545870 T1747 C774 P49696 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 545870 T1747 C774 P49696 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 545870 T1747 C774 P49696 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 545870 T1747 C774 P49696 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 545871 T1747 C774 P49696 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:49688/ce/ib/collection1/. core=collection1
[junit4:junit4] 2> 545872 T1747 C774 P49696 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 545873 T1653 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C777 name=collection1 org.apache.solr.core.SolrCore@1bb799c3 url=http://127.0.0.1:49688/ce/ib/collection1 node=127.0.0.1:49688_ce%2Fib C777_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49688_ce%2Fib, base_url=http://127.0.0.1:49688/ce/ib, leader=true}
[junit4:junit4] 2> 545880 T1702 C777 P49688 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 545888 T1703 C777 P49688 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 545891 T1703 C777 P49688 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4e50b5d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@747480c5),segFN=segments_1,generation=1}
[junit4:junit4] 2> 545892 T1703 C777 P49688 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 545892 T1703 C777 P49688 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4e50b5d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@747480c5),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4e50b5d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@747480c5),segFN=segments_2,generation=2}
[junit4:junit4] 2> 545893 T1703 C777 P49688 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 545893 T1703 C777 P49688 oass.SolrIndexSearcher.<init> Opening Searcher@3ba71336 realtime
[junit4:junit4] 2> 545894 T1703 C777 P49688 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 545894 T1703 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 545895 T1747 C774 P49696 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 545896 T1747 C774 P49696 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 545898 T1704 C777 P49688 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 545898 T1704 C777 P49688 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 545899 T1747 C774 P49696 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 545899 T1747 C774 P49696 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 545899 T1747 C774 P49696 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 545902 T1704 C777 P49688 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 545903 T1747 C774 P49696 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 545904 T1747 C774 P49696 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index.20130522224339318
[junit4:junit4] 2> 545904 T1747 C774 P49696 oash.SnapPuller.fetchLatestIndex Starting download to BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2de7632c lockFactory=org.apache.lucene.store.NativeFSLockFactory@66e80979) fullCopy=false
[junit4:junit4] 2> 545907 T1704 C777 P49688 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 545908 T1747 C774 P49696 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 545910 T1747 C774 P49696 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 545910 T1747 C774 P49696 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 545912 T1747 C774 P49696 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@676b9033 lockFactory=org.apache.lucene.store.NativeFSLockFactory@71a992d1),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@676b9033 lockFactory=org.apache.lucene.store.NativeFSLockFactory@71a992d1),segFN=segments_2,generation=2}
[junit4:junit4] 2> 545913 T1747 C774 P49696 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 545913 T1747 C774 P49696 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 545913 T1747 C774 P49696 oass.SolrIndexSearcher.<init> Opening Searcher@3f8da4ac main
[junit4:junit4] 2> 545914 T1746 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f8da4ac main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 545915 T1747 C774 P49696 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index.20130522224339318 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index.20130522224339318;done=true>>]
[junit4:junit4] 2> 545915 T1747 C774 P49696 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index.20130522224339318
[junit4:junit4] 2> 545916 T1747 C774 P49696 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index.20130522224339318
[junit4:junit4] 2> 545916 T1747 C774 P49696 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 545916 T1747 C774 P49696 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 545916 T1747 C774 P49696 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 545917 T1747 C774 P49696 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 545918 T1747 C774 P49696 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 546604 T1676 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 546605 T1676 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49696_ce%2Fib",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49696/ce/ib"}
[junit4:junit4] 2> 546646 T1695 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 546646 T1727 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 546646 T1744 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 546646 T1711 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 546646 T1682 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 546646 T1675 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 546875 T1653 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 546876 T1653 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C778 name=collection1 org.apache.solr.core.SolrCore@3bd20721 url=http://127.0.0.1:49675/ce/ib/collection1 node=127.0.0.1:49675_ce%2Fib C778_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:49675_ce%2Fib, base_url=http://127.0.0.1:49675/ce/ib, leader=true}
[junit4:junit4] 2> 546886 T1665 C778 P49675 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 546889 T1665 C778 P49675 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a06d16e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a3cb03d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 546889 T1665 C778 P49675 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 546890 T1665 C778 P49675 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a06d16e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a3cb03d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a06d16e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a3cb03d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 546891 T1665 C778 P49675 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 546892 T1665 C778 P49675 oass.SolrIndexSearcher.<init> Opening Searcher@14426182 main
[junit4:junit4] 2> 546892 T1665 C778 P49675 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 546893 T1679 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14426182 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 546894 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 546909 T1705 C777 P49688 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 546910 T1705 C777 P49688 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4e50b5d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@747480c5),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4e50b5d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@747480c5),segFN=segments_3,generation=3}
[junit4:junit4] 2> 546911 T1705 C777 P49688 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 546912 T1705 C777 P49688 oass.SolrIndexSearcher.<init> Opening Searcher@3c401213 main
[junit4:junit4] 2> 546912 T1705 C777 P49688 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 546913 T1713 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3c401213 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 546931 T1705 C777 P49688 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:49684/ce/ib/collection1/, StdNode: http://127.0.0.1:49692/ce/ib/collection1/, StdNode: http://127.0.0.1:49696/ce/ib/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 546940 T1689 C776 P49684 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 546942 T1689 C776 P49684 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@580cd615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e428d9d),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@580cd615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e428d9d),segFN=segments_3,generation=3}
[junit4:junit4] 2> 546942 T1689 C776 P49684 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 546943 T1689 C776 P49684 oass.SolrIndexSearcher.<init> Opening Searcher@6229981 main
[junit4:junit4] 2> 546943 T1689 C776 P49684 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 546944 T1697 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6229981 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 546945 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C775_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49692_ce%2Fib, base_url=http://127.0.0.1:49692/ce/ib}
[junit4:junit4] 2> 546948 T1717 C775 P49692 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C774_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:49696_ce%2Fib, base_url=http://127.0.0.1:49696/ce/ib}
[junit4:junit4] 2> 546948 T1734 C774 P49696 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 546949 T1717 C775 P49692 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@471578f4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a99923b),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@471578f4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a99923b),segFN=segments_3,generation=3}
[junit4:junit4] 2> 546950 T1734 C774 P49696 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@676b9033 lockFactory=org.apache.lucene.store.NativeFSLockFactory@71a992d1),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@676b9033 lockFactory=org.apache.lucene.store.NativeFSLockFactory@71a992d1),segFN=segments_3,generation=3}
[junit4:junit4] 2> 546950 T1717 C775 P49692 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 546950 T1734 C774 P49696 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 546951 T1717 C775 P49692 oass.SolrIndexSearcher.<init> Opening Searcher@62fb20b4 main
[junit4:junit4] 2> 546952 T1734 C774 P49696 oass.SolrIndexSearcher.<init> Opening Searcher@f1722d2 main
[junit4:junit4] 2> 546952 T1717 C775 P49692 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 546953 T1729 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@62fb20b4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 546952 T1734 C774 P49696 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 546953 T1717 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 546953 T1746 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f1722d2 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 546954 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 546955 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 47
[junit4:junit4] 2> 546956 T1653 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 546960 T1690 C776 P49684 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 546963 T1718 C775 P49692 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 546965 T1706 C777 P49688 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 546968 T1735 C774 P49696 oasc.SolrCore.execute [collection1] webapp=/ce/ib path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 548985 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435791023032762368)} 0 13
[junit4:junit4] 2> 549002 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={update.distrib=FROMLEADER&_version_=-1435791023043248128&update.from=http://127.0.0.1:49684/ce/ib/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435791023043248128)} 0 2
[junit4:junit4] 2> 549007 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={update.distrib=FROMLEADER&_version_=-1435791023055831040&update.from=http://127.0.0.1:49688/ce/ib/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435791023055831040)} 0 2
[junit4:junit4] 2> 549007 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435791023055831040)} 0 7
[junit4:junit4] 2> 549008 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435791023043248128)} 0 20
[junit4:junit4] 2> 549012 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[0 (1435791023068413952)]} 0 1
[junit4:junit4] 2> 549031 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435791023071559680)]} 0 1
[junit4:junit4] 2> 549032 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[0 (1435791023071559680)]} 0 17
[junit4:junit4] 2> 549036 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[1 (1435791023092531200)]} 0 1
[junit4:junit4] 2> 549042 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435791023095676928)]} 0 1
[junit4:junit4] 2> 549042 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[1 (1435791023095676928)]} 0 4
[junit4:junit4] 2> 549046 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[2 (1435791023103016960)]} 0 1
[junit4:junit4] 2> 549053 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435791023107211264)]} 0 1
[junit4:junit4] 2> 549054 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[2 (1435791023107211264)]} 0 5
[junit4:junit4] 2> 549058 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[3 (1435791023115599872)]} 0 1
[junit4:junit4] 2> 549074 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435791023129231360)]} 0 1
[junit4:junit4] 2> 549075 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1435791023129231360)]} 0 5
[junit4:junit4] 2> 549075 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[3]} 0 14
[junit4:junit4] 2> 549079 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[4 (1435791023137619968)]} 0 1
[junit4:junit4] 2> 549089 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435791023144960000)]} 0 1
[junit4:junit4] 2> 549089 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1435791023144960000)]} 0 4
[junit4:junit4] 2> 549090 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[4]} 0 8
[junit4:junit4] 2> 549094 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[5 (1435791023153348608)]} 0 1
[junit4:junit4] 2> 549103 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435791023159640064)]} 0 1
[junit4:junit4] 2> 549103 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1435791023159640064)]} 0 4
[junit4:junit4] 2> 549104 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[5]} 0 8
[junit4:junit4] 2> 549108 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[6 (1435791023168028672)]} 0 1
[junit4:junit4] 2> 549114 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435791023171174400)]} 0 1
[junit4:junit4] 2> 549114 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[6 (1435791023171174400)]} 0 4
[junit4:junit4] 2> 549118 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[7 (1435791023179563008)]} 0 1
[junit4:junit4] 2> 549125 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435791023182708736)]} 0 1
[junit4:junit4] 2> 549126 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[7 (1435791023182708736)]} 0 5
[junit4:junit4] 2> 549129 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[8 (1435791023190048768)]} 0 1
[junit4:junit4] 2> 549138 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435791023196340224)]} 0 1
[junit4:junit4] 2> 549138 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1435791023196340224)]} 0 4
[junit4:junit4] 2> 549139 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[8]} 0 8
[junit4:junit4] 2> 549143 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[9 (1435791023204728832)]} 0 1
[junit4:junit4] 2> 549150 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435791023208923136)]} 0 1
[junit4:junit4] 2> 549151 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[9 (1435791023208923136)]} 0 5
[junit4:junit4] 2> 549154 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[10 (1435791023216263168)]} 0 1
[junit4:junit4] 2> 549160 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435791023219408896)]} 0 1
[junit4:junit4] 2> 549160 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[10 (1435791023219408896)]} 0 4
[junit4:junit4] 2> 549164 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[11 (1435791023226748928)]} 0 1
[junit4:junit4] 2> 549171 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435791023230943232)]} 0 1
[junit4:junit4] 2> 549172 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[11 (1435791023230943232)]} 0 5
[junit4:junit4] 2> 549175 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[12 (1435791023238283264)]} 0 1
[junit4:junit4] 2> 549185 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435791023245623296)]} 0 1
[junit4:junit4] 2> 549185 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[12 (1435791023245623296)]} 0 4
[junit4:junit4] 2> 549186 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[12]} 0 8
[junit4:junit4] 2> 549190 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[13 (1435791023254011904)]} 0 1
[junit4:junit4] 2> 549200 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435791023262400512)]} 0 1
[junit4:junit4] 2> 549201 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[13 (1435791023262400512)]} 0 5
[junit4:junit4] 2> 549201 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[13]} 0 8
[junit4:junit4] 2> 549205 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[14 (1435791023269740544)]} 0 1
[junit4:junit4] 2> 549215 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435791023278129152)]} 0 1
[junit4:junit4] 2> 549215 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1435791023278129152)]} 0 4
[junit4:junit4] 2> 549216 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[14]} 0 8
[junit4:junit4] 2> 549220 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[15 (1435791023285469184)]} 0 1
[junit4:junit4] 2> 549227 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435791023289663488)]} 0 1
[junit4:junit4] 2> 549227 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[15 (1435791023289663488)]} 0 4
[junit4:junit4] 2> 549231 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[16 (1435791023297003520)]} 0 1
[junit4:junit4] 2> 549238 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435791023301197824)]} 0 1
[junit4:junit4] 2> 549238 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[16 (1435791023301197824)]} 0 4
[junit4:junit4] 2> 549242 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[17 (1435791023308537856)]} 0 1
[junit4:junit4] 2> 549251 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435791023314829312)]} 0 1
[junit4:junit4] 2> 549252 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1435791023314829312)]} 0 5
[junit4:junit4] 2> 549252 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[17]} 0 8
[junit4:junit4] 2> 549256 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[18 (1435791023323217920)]} 0 1
[junit4:junit4] 2> 549266 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435791023330557952)]} 0 1
[junit4:junit4] 2> 549267 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[18 (1435791023330557952)]} 0 5
[junit4:junit4] 2> 549267 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[18]} 0 8
[junit4:junit4] 2> 549271 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[19 (1435791023338946560)]} 0 1
[junit4:junit4] 2> 549281 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435791023346286592)]} 0 1
[junit4:junit4] 2> 549281 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[19 (1435791023346286592)]} 0 4
[junit4:junit4] 2> 549282 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[19]} 0 8
[junit4:junit4] 2> 549286 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[20 (1435791023354675200)]} 0 1
[junit4:junit4] 2> 549293 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435791023358869504)]} 0 1
[junit4:junit4] 2> 549294 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[20 (1435791023358869504)]} 0 5
[junit4:junit4] 2> 549298 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[21 (1435791023367258112)]} 0 1
[junit4:junit4] 2> 549307 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435791023373549568)]} 0 1
[junit4:junit4] 2> 549307 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[21 (1435791023373549568)]} 0 4
[junit4:junit4] 2> 549308 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[21]} 0 8
[junit4:junit4] 2> 549312 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[22 (1435791023381938176)]} 0 1
[junit4:junit4] 2> 549322 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435791023389278208)]} 0 1
[junit4:junit4] 2> 549322 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1435791023389278208)]} 0 4
[junit4:junit4] 2> 549323 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[22]} 0 8
[junit4:junit4] 2> 549327 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[23 (1435791023397666816)]} 0 1
[junit4:junit4] 2> 549333 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435791023400812544)]} 0 1
[junit4:junit4] 2> 549333 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[23 (1435791023400812544)]} 0 4
[junit4:junit4] 2> 549337 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[24 (1435791023408152576)]} 0 1
[junit4:junit4] 2> 549343 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435791023411298304)]} 0 1
[junit4:junit4] 2> 549343 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[24 (1435791023411298304)]} 0 4
[junit4:junit4] 2> 549347 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[25 (1435791023418638336)]} 0 1
[junit4:junit4] 2> 549356 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435791023424929792)]} 0 1
[junit4:junit4] 2> 549356 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1435791023424929792)]} 0 4
[junit4:junit4] 2> 549357 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[25]} 0 8
[junit4:junit4] 2> 549361 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[26 (1435791023433318400)]} 0 1
[junit4:junit4] 2> 549367 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435791023436464128)]} 0 1
[junit4:junit4] 2> 549367 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[26 (1435791023436464128)]} 0 4
[junit4:junit4] 2> 549370 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[27 (1435791023443804160)]} 0 0
[junit4:junit4] 2> 549377 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435791023446949888)]} 0 1
[junit4:junit4] 2> 549377 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[27 (1435791023446949888)]} 0 4
[junit4:junit4] 2> 549381 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[28 (1435791023454289920)]} 0 1
[junit4:junit4] 2> 549387 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435791023457435648)]} 0 1
[junit4:junit4] 2> 549387 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[28 (1435791023457435648)]} 0 4
[junit4:junit4] 2> 549391 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[29 (1435791023464775680)]} 0 1
[junit4:junit4] 2> 549397 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435791023467921408)]} 0 1
[junit4:junit4] 2> 549397 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[29 (1435791023467921408)]} 0 4
[junit4:junit4] 2> 549401 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[30 (1435791023475261440)]} 0 1
[junit4:junit4] 2> 549410 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435791023481552896)]} 0 1
[junit4:junit4] 2> 549410 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[30 (1435791023481552896)]} 0 4
[junit4:junit4] 2> 549411 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[30]} 0 8
[junit4:junit4] 2> 549415 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[31 (1435791023489941504)]} 0 1
[junit4:junit4] 2> 549424 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435791023496232960)]} 0 1
[junit4:junit4] 2> 549424 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[31 (1435791023496232960)]} 0 4
[junit4:junit4] 2> 549425 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[31]} 0 8
[junit4:junit4] 2> 549429 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[32 (1435791023504621568)]} 0 1
[junit4:junit4] 2> 549438 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435791023510913024)]} 0 1
[junit4:junit4] 2> 549438 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[32 (1435791023510913024)]} 0 4
[junit4:junit4] 2> 549439 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[32]} 0 8
[junit4:junit4] 2> 549443 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[33 (1435791023519301632)]} 0 1
[junit4:junit4] 2> 549452 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435791023525593088)]} 0 1
[junit4:junit4] 2> 549452 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[33 (1435791023525593088)]} 0 4
[junit4:junit4] 2> 549453 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[33]} 0 8
[junit4:junit4] 2> 549457 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[34 (1435791023533981696)]} 0 1
[junit4:junit4] 2> 549466 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1435791023540273152)]} 0 1
[junit4:junit4] 2> 549466 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[34 (1435791023540273152)]} 0 4
[junit4:junit4] 2> 549467 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[34]} 0 8
[junit4:junit4] 2> 549471 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[35 (1435791023548661760)]} 0 1
[junit4:junit4] 2> 549477 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1435791023551807488)]} 0 1
[junit4:junit4] 2> 549477 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[35 (1435791023551807488)]} 0 4
[junit4:junit4] 2> 549481 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[36 (1435791023559147520)]} 0 1
[junit4:junit4] 2> 549487 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1435791023562293248)]} 0 1
[junit4:junit4] 2> 549487 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[36 (1435791023562293248)]} 0 4
[junit4:junit4] 2> 549491 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[37 (1435791023569633280)]} 0 1
[junit4:junit4] 2> 549497 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1435791023572779008)]} 0 1
[junit4:junit4] 2> 549497 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[37 (1435791023572779008)]} 0 4
[junit4:junit4] 2> 549501 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[38 (1435791023580119040)]} 0 1
[junit4:junit4] 2> 549507 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1435791023583264768)]} 0 1
[junit4:junit4] 2> 549507 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[38 (1435791023583264768)]} 0 4
[junit4:junit4] 2> 549511 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[39 (1435791023590604800)]} 0 1
[junit4:junit4] 2> 549520 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1435791023596896256)]} 0 1
[junit4:junit4] 2> 549520 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[39 (1435791023596896256)]} 0 4
[junit4:junit4] 2> 549521 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[39]} 0 8
[junit4:junit4] 2> 549525 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[40 (1435791023605284864)]} 0 1
[junit4:junit4] 2> 549531 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1435791023608430592)]} 0 1
[junit4:junit4] 2> 549531 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[40 (1435791023608430592)]} 0 4
[junit4:junit4] 2> 549535 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[41 (1435791023615770624)]} 0 1
[junit4:junit4] 2> 549541 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1435791023618916352)]} 0 1
[junit4:junit4] 2> 549541 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[41 (1435791023618916352)]} 0 4
[junit4:junit4] 2> 549545 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[42 (1435791023626256384)]} 0 1
[junit4:junit4] 2> 549551 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1435791023629402112)]} 0 1
[junit4:junit4] 2> 549551 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[42 (1435791023629402112)]} 0 4
[junit4:junit4] 2> 549555 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[43 (1435791023636742144)]} 0 1
[junit4:junit4] 2> 549564 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1435791023643033600)]} 0 1
[junit4:junit4] 2> 549564 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[43 (1435791023643033600)]} 0 4
[junit4:junit4] 2> 549565 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[43]} 0 8
[junit4:junit4] 2> 549569 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[44 (1435791023651422208)]} 0 1
[junit4:junit4] 2> 549578 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1435791023657713664)]} 0 1
[junit4:junit4] 2> 549578 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[44 (1435791023657713664)]} 0 4
[junit4:junit4] 2> 549579 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[44]} 0 8
[junit4:junit4] 2> 549583 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[45 (1435791023666102272)]} 0 1
[junit4:junit4] 2> 549589 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1435791023669248000)]} 0 1
[junit4:junit4] 2> 549589 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[45 (1435791023669248000)]} 0 4
[junit4:junit4] 2> 549593 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[46 (1435791023676588032)]} 0 1
[junit4:junit4] 2> 549599 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1435791023679733760)]} 0 1
[junit4:junit4] 2> 549599 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[46 (1435791023679733760)]} 0 4
[junit4:junit4] 2> 549603 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[47 (1435791023687073792)]} 0 1
[junit4:junit4] 2> 549609 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1435791023690219520)]} 0 1
[junit4:junit4] 2> 549609 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[47 (1435791023690219520)]} 0 4
[junit4:junit4] 2> 549613 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[48 (1435791023697559552)]} 0 1
[junit4:junit4] 2> 549622 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1435791023703851008)]} 0 1
[junit4:junit4] 2> 549622 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[48 (1435791023703851008)]} 0 4
[junit4:junit4] 2> 549623 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[48]} 0 8
[junit4:junit4] 2> 549627 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[49 (1435791023712239616)]} 0 1
[junit4:junit4] 2> 549633 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1435791023715385344)]} 0 1
[junit4:junit4] 2> 549633 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[49 (1435791023715385344)]} 0 4
[junit4:junit4] 2> 549637 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[50 (1435791023722725376)]} 0 1
[junit4:junit4] 2> 549646 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1435791023730065408)]} 0 1
[junit4:junit4] 2> 549646 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[50 (1435791023730065408)]} 0 4
[junit4:junit4] 2> 549647 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[50]} 0 8
[junit4:junit4] 2> 549651 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[51 (1435791023737405440)]} 0 1
[junit4:junit4] 2> 549660 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1435791023743696896)]} 0 1
[junit4:junit4] 2> 549660 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[51 (1435791023743696896)]} 0 4
[junit4:junit4] 2> 549661 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[51]} 0 8
[junit4:junit4] 2> 549665 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[52 (1435791023752085504)]} 0 1
[junit4:junit4] 2> 549671 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1435791023755231232)]} 0 1
[junit4:junit4] 2> 549671 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[52 (1435791023755231232)]} 0 4
[junit4:junit4] 2> 549675 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[53 (1435791023762571264)]} 0 1
[junit4:junit4] 2> 549684 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1435791023768862720)]} 0 1
[junit4:junit4] 2> 549684 T1707 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1435791023768862720)]} 0 4
[junit4:junit4] 2> 549685 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[53]} 0 8
[junit4:junit4] 2> 549689 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[54 (1435791023777251328)]} 0 1
[junit4:junit4] 2> 549695 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1435791023780397056)]} 0 1
[junit4:junit4] 2> 549695 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[54 (1435791023780397056)]} 0 4
[junit4:junit4] 2> 549699 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[55 (1435791023787737088)]} 0 1
[junit4:junit4] 2> 549705 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1435791023790882816)]} 0 1
[junit4:junit4] 2> 549705 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[55 (1435791023790882816)]} 0 4
[junit4:junit4] 2> 549709 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[56 (1435791023798222848)]} 0 1
[junit4:junit4] 2> 549715 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1435791023801368576)]} 0 1
[junit4:junit4] 2> 549715 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[56 (1435791023801368576)]} 0 4
[junit4:junit4] 2> 549719 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[57 (1435791023808708608)]} 0 1
[junit4:junit4] 2> 549725 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1435791023811854336)]} 0 1
[junit4:junit4] 2> 549725 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[57 (1435791023811854336)]} 0 4
[junit4:junit4] 2> 549729 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[58 (1435791023819194368)]} 0 1
[junit4:junit4] 2> 549735 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1435791023822340096)]} 0 1
[junit4:junit4] 2> 549735 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[58 (1435791023822340096)]} 0 4
[junit4:junit4] 2> 549739 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[59 (1435791023829680128)]} 0 1
[junit4:junit4] 2> 549745 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1435791023832825856)]} 0 1
[junit4:junit4] 2> 549745 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[59 (1435791023832825856)]} 0 4
[junit4:junit4] 2> 549749 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[60 (1435791023840165888)]} 0 1
[junit4:junit4] 2> 549755 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1435791023843311616)]} 0 1
[junit4:junit4] 2> 549755 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[60 (1435791023843311616)]} 0 4
[junit4:junit4] 2> 549759 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[61 (1435791023850651648)]} 0 1
[junit4:junit4] 2> 549768 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1435791023856943104)]} 0 1
[junit4:junit4] 2> 549768 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[61 (1435791023856943104)]} 0 4
[junit4:junit4] 2> 549769 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[61]} 0 8
[junit4:junit4] 2> 549773 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[62 (1435791023865331712)]} 0 1
[junit4:junit4] 2> 549779 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1435791023868477440)]} 0 1
[junit4:junit4] 2> 549779 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[62 (1435791023868477440)]} 0 4
[junit4:junit4] 2> 549783 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[63 (1435791023875817472)]} 0 1
[junit4:junit4] 2> 549792 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1435791023882108928)]} 0 1
[junit4:junit4] 2> 549792 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[63 (1435791023882108928)]} 0 4
[junit4:junit4] 2> 549793 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[63]} 0 8
[junit4:junit4] 2> 549797 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[64 (1435791023890497536)]} 0 1
[junit4:junit4] 2> 549808 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1435791023898886144)]} 0 1
[junit4:junit4] 2> 549809 T1689 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[64 (1435791023898886144)]} 0 6
[junit4:junit4] 2> 549810 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[64]} 0 10
[junit4:junit4] 2> 549813 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[65 (1435791023907274752)]} 0 1
[junit4:junit4] 2> 549820 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[65 (1435791023911469056)]} 0 1
[junit4:junit4] 2> 549820 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[65 (1435791023911469056)]} 0 4
[junit4:junit4] 2> 549824 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[66 (1435791023918809088)]} 0 1
[junit4:junit4] 2> 549830 T1719 C775 P49692 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49684/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[66 (1435791023921954816)]} 0 1
[junit4:junit4] 2> 549830 T1691 C776 P49684 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[66 (1435791023921954816)]} 0 4
[junit4:junit4] 2> 549834 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[67 (1435791023929294848)]} 0 1
[junit4:junit4] 2> 549840 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[67 (1435791023932440576)]} 0 1
[junit4:junit4] 2> 549840 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[67 (1435791023932440576)]} 0 4
[junit4:junit4] 2> 549844 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[68 (1435791023939780608)]} 0 1
[junit4:junit4] 2> 549850 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={distrib.from=http://127.0.0.1:49688/ce/ib/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[68 (1435791023942926336)]} 0 1
[junit4:junit4] 2> 549850 T1705 C777 P49688 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[68 (1435791023942926336)]} 0 4
[junit4:junit4] 2> 549854 T1665 C778 P49675 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update params={wt=javabin&version=2} {add=[69 (1435791023950266368)]} 0 1
[junit4:junit4] 2> 549861 T1734 C774 P49696 oasup.LogUpdateProcessor.finish [collection1] webapp=/ce/ib path=/update p
[...truncated too long message...]
ca1/data/index
[junit4:junit4] 2> 754228 T1826 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89736937228926986-127.0.0.1:49692_ce%2Fib-n_0000000003) am no longer a leader.
[junit4:junit4] 2> 754229 T1727 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 754230 T1727 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 754230 T1727 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 754230 T1653 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/ce/ib,null}
[junit4:junit4] 2> 754232 T1744 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 754234 T1744 oasc.Overseer.start Overseer (id=89736937228926988-127.0.0.1:49696_ce%2Fib-n_0000000004) starting
[junit4:junit4] 2> 754238 T1744 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 754238 T1829 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 754239 T1744 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 754240 T1828 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 754284 T1653 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 49696
[junit4:junit4] 2> 754284 T1653 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=539011038
[junit4:junit4] 2> 755287 T1653 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 755287 T1653 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 755292 T1653 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@35368958
[junit4:junit4] 2> 755293 T1653 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=658,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 755294 T1653 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 755294 T1653 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 755295 T1653 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 755298 T1653 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 755298 T1653 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 755299 T1653 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index;done=false>>]
[junit4:junit4] 2> 755299 T1653 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4/index
[junit4:junit4] 2> 755300 T1653 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4;done=false>>]
[junit4:junit4] 2> 755300 T1653 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285/jetty4
[junit4:junit4] 2> 755301 T1828 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89736937228926988-127.0.0.1:49696_ce%2Fib-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 755302 T1744 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 755303 T1744 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 755303 T1653 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/ce/ib,null}
[junit4:junit4] 2> 755303 T1744 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 755374 T1653 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 755376 T1653 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49672 49672
[junit4:junit4] 2> 755434 T1653 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 49675
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369276996285 FAILED !!!!!
[junit4:junit4] 2> 755435 T1653 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 755436 T1653 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49672 49672
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=79BD7E6824107870 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_PH -Dtests.timezone=America/Blanc-Sablon -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 233s J0 | ChaosMonkeyShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:49684/ce/ib returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([79BD7E6824107870:F85BF070534F184C]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 755463 T1653 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 232602 T1652 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=MockFixedIntBlock(blockSize=1567), _version_=PostingsFormat(name=NestedPulsing)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=en_PH, timezone=America/Blanc-Sablon
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=199305864,total=414187520
[junit4:junit4] 2> NOTE: All tests run in this JVM: [IndexReaderFactoryTest, ExternalFileFieldSortTest, TestFieldTypeResource, ConvertedLegacyTest, DateFieldTest, TestPHPSerializedResponseWriter, TestDynamicFieldCollectionResource, TestDistributedSearch, OverseerTest, TestFastWriter, ScriptEngineTest, TestXIncludeConfig, SynonymTokenizerTest, TestCloudManagedSchema, TestReload, TestRandomFaceting, TestCSVResponseWriter, TestNumberUtils, DirectSolrSpellCheckerTest, StandardRequestHandlerTest, NumericFieldsTest, PreAnalyzedFieldTest, PingRequestHandlerTest, PluginInfoTest, ShowFileRequestHandlerTest, LeaderElectionIntegrationTest, TimeZoneUtilsTest, ShardRoutingCustomTest, LoggingHandlerTest, OutputWriterTest, TestSystemIdResolver, TestMultiCoreConfBootstrap, TestMergePolicyConfig, OverseerCollectionProcessorTest, PreAnalyzedUpdateProcessorTest, CurrencyFieldXmlFileTest, SolrInfoMBeanTest, TestAnalyzedSuggestions, TestLFUCache, ResponseLogComponentTest, SpellingQueryConverterTest, TestLazyCores, TestStressRecovery, ZkControllerTest, TestFieldTypeCollectionResource, IndexSchemaTest, TestWriterPerf, SuggesterWFSTTest, TestClassNameShortening, TestPluginEnable, LeaderElectionTest, TestUniqueKeyFieldResource, TermsComponentTest, XmlUpdateRequestHandlerTest, DebugComponentTest, SliceStateTest, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 232.88s, 1 test, 1 error <<< FAILURES!
[...truncated 510 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:386: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:366: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 13 ignored (7 assumptions)
Total time: 50 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1275 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1275/
1 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:47829 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:47829 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([257770F75ABD574C:A491FEEF2DE23770]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9675 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 985829 T2338 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 985834 T2338 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-ShardSplitTest-1369262972246
[junit4:junit4] 2> 985835 T2338 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 985836 T2339 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 985937 T2338 oasc.ZkTestServer.run start zk server on port:50302
[junit4:junit4] 2> 985938 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 985941 T2345 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b5bd5d name:ZooKeeperConnection Watcher:127.0.0.1:50302 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 985942 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 985942 T2338 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 985946 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 985948 T2347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50323255 name:ZooKeeperConnection Watcher:127.0.0.1:50302/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 985948 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 985949 T2338 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 985959 T2338 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 985962 T2338 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 985964 T2338 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 985966 T2338 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 985967 T2338 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 985978 T2338 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 985979 T2338 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 986082 T2338 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 986083 T2338 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 986085 T2338 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 986086 T2338 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 986088 T2338 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 986089 T2338 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 986096 T2338 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 986097 T2338 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 986099 T2338 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 986100 T2338 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 986102 T2338 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 986103 T2338 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 986111 T2338 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 986111 T2338 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 986285 T2338 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 986290 T2338 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:39132
[junit4:junit4] 2> 986291 T2338 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 986291 T2338 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 986292 T2338 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369262972526
[junit4:junit4] 2> 986292 T2338 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369262972526/solr.xml
[junit4:junit4] 2> 986292 T2338 oasc.CoreContainer.<init> New CoreContainer 1662572386
[junit4:junit4] 2> 986293 T2338 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369262972526/'
[junit4:junit4] 2> 986293 T2338 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369262972526/'
[junit4:junit4] 2> 986379 T2338 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 986380 T2338 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 986380 T2338 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 986381 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 986381 T2338 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 986381 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 986382 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 986382 T2338 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 986383 T2338 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 986383 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 986394 T2338 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 986395 T2338 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50302/solr
[junit4:junit4] 2> 986395 T2338 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 986396 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 986398 T2358 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d28371 name:ZooKeeperConnection Watcher:127.0.0.1:50302 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 986399 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 986401 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 986409 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 986411 T2360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12bf1aeb name:ZooKeeperConnection Watcher:127.0.0.1:50302/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 986411 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 986413 T2338 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 986423 T2338 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 986426 T2338 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 986432 T2338 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39132_
[junit4:junit4] 2> 986433 T2338 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39132_
[junit4:junit4] 2> 986441 T2338 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 986453 T2338 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 986460 T2338 oasc.Overseer.start Overseer (id=89736018149441539-127.0.0.1:39132_-n_0000000000) starting
[junit4:junit4] 2> 986464 T2338 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 986477 T2362 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 986477 T2338 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 986479 T2338 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 986487 T2338 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 986489 T2361 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 986492 T2363 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369262972526/collection1
[junit4:junit4] 2> 986492 T2363 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 986493 T2363 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 986493 T2363 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 986494 T2363 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369262972526/collection1/'
[junit4:junit4] 2> 986495 T2363 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369262972526/collection1/lib/README' to classloader
[junit4:junit4] 2> 986496 T2363 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369262972526/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 986542 T2363 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 986603 T2363 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 986704 T2363 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 986710 T2363 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 986992 T3 oasc.CoreContainer.finalize ERROR CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=641714439
[junit4:junit4] 2> 987306 T2363 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 987310 T2363 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 987312 T2363 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 987317 T2363 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 987341 T2363 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 987342 T2363 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369262972526/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369262972245/control/data/
[junit4:junit4] 2> 987342 T2363 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38cc9aee
[junit4:junit4] 2> 987343 T2363 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 987343 T2363 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/control/data
[junit4:junit4] 2> 987344 T2363 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369262972245/control/data/index/
[junit4:junit4] 2> 987344 T2363 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369262972245/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 987345 T2363 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/control/data/index
[junit4:junit4] 2> 987350 T2363 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61c8275b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6909edda),segFN=segments_1,generation=1}
[junit4:junit4] 2> 987350 T2363 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 987353 T2363 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 987354 T2363 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 987354 T2363 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 987355 T2363 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 987356 T2363 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 987356 T2363 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 987356 T2363 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 987357 T2363 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 987357 T2363 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 987373 T2363 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 987381 T2363 oass.SolrIndexSearcher.<init> Opening Searcher@5be91161 main
[junit4:junit4] 2> 987381 T2363 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369262972245/control/data/tlog
[junit4:junit4] 2> 987383 T2363 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 987383 T2363 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 987387 T2364 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5be91161 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 987389 T2363 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 987389 T2363 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 987992 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 987993 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:39132_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39132"}
[junit4:junit4] 2> 987993 T2361 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 987994 T2361 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 988044 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 988402 T2363 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 988402 T2363 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39132 collection:control_collection shard:shard1
[junit4:junit4] 2> 988403 T2363 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 988426 T2363 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 988429 T2363 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 988430 T2363 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 988430 T2363 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39132/collection1/
[junit4:junit4] 2> 988430 T2363 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 988431 T2363 oasc.SyncStrategy.syncToMe http://127.0.0.1:39132/collection1/ has no replicas
[junit4:junit4] 2> 988431 T2363 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39132/collection1/
[junit4:junit4] 2> 988431 T2363 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 989548 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 989574 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 989623 T2363 oasc.ZkController.register We are http://127.0.0.1:39132/collection1/ and leader is http://127.0.0.1:39132/collection1/
[junit4:junit4] 2> 989623 T2363 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39132
[junit4:junit4] 2> 989623 T2363 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 989624 T2363 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 989624 T2363 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 989626 T2363 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 989627 T2338 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 989628 T2338 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 989629 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 989644 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 989646 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 989648 T2367 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61b8c5b6 name:ZooKeeperConnection Watcher:127.0.0.1:50302/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 989648 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 989650 T2338 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 989652 T2338 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 989912 T2338 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 989915 T2338 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:47829
[junit4:junit4] 2> 989916 T2338 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 989917 T2338 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 989917 T2338 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369262976063
[junit4:junit4] 2> 989918 T2338 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369262976063/solr.xml
[junit4:junit4] 2> 989918 T2338 oasc.CoreContainer.<init> New CoreContainer 1944453949
[junit4:junit4] 2> 989919 T2338 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369262976063/'
[junit4:junit4] 2> 989920 T2338 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369262976063/'
[junit4:junit4] 2> 990048 T2338 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 990050 T2338 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 990050 T2338 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 990051 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 990051 T2338 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 990052 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 990052 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 990053 T2338 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 990053 T2338 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 990054 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 990070 T2338 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 990070 T2338 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50302/solr
[junit4:junit4] 2> 990071 T2338 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 990072 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 990076 T2378 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bce3f35 name:ZooKeeperConnection Watcher:127.0.0.1:50302 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 990076 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 990090 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 990101 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 990103 T2380 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@227a8269 name:ZooKeeperConnection Watcher:127.0.0.1:50302/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 990104 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 990108 T2338 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 991080 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 991081 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:39132_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39132"}
[junit4:junit4] 2> 991095 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 991095 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 991095 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 991112 T2338 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47829_
[junit4:junit4] 2> 991114 T2338 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47829_
[junit4:junit4] 2> 991116 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 991116 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 991117 T2360 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 991117 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 991118 T2380 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 991118 T2367 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 991124 T2381 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369262976063/collection1
[junit4:junit4] 2> 991124 T2381 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 991125 T2381 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 991125 T2381 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 991127 T2381 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369262976063/collection1/'
[junit4:junit4] 2> 991128 T2381 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369262976063/collection1/lib/README' to classloader
[junit4:junit4] 2> 991129 T2381 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369262976063/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 991182 T2381 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 991244 T2381 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 991345 T2381 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 991352 T2381 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 991945 T2381 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 991949 T2381 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 991951 T2381 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 991956 T2381 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 991979 T2381 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 991980 T2381 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369262976063/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty1/
[junit4:junit4] 2> 991980 T2381 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38cc9aee
[junit4:junit4] 2> 991981 T2381 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 991981 T2381 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty1
[junit4:junit4] 2> 991982 T2381 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty1/index/
[junit4:junit4] 2> 991982 T2381 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 991982 T2381 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty1/index
[junit4:junit4] 2> 991986 T2381 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@348b90c8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76402c9b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 991987 T2381 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 991990 T2381 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 991991 T2381 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 991991 T2381 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 991992 T2381 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 991993 T2381 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 991993 T2381 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 991994 T2381 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 991994 T2381 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 991995 T2381 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 992012 T2381 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 992019 T2381 oass.SolrIndexSearcher.<init> Opening Searcher@1c87ab9b main
[junit4:junit4] 2> 992020 T2381 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty1/tlog
[junit4:junit4] 2> 992021 T2381 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 992021 T2381 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 992025 T2382 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c87ab9b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 992027 T2381 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 992028 T2381 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 992600 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 992601 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47829_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47829"}
[junit4:junit4] 2> 992601 T2361 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 992602 T2361 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 992615 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 992615 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 992615 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 993031 T2381 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 993031 T2381 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47829 collection:collection1 shard:shard1
[junit4:junit4] 2> 993032 T2381 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 993053 T2381 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 993064 T2381 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 993064 T2381 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 993065 T2381 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47829/collection1/
[junit4:junit4] 2> 993065 T2381 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 993065 T2381 oasc.SyncStrategy.syncToMe http://127.0.0.1:47829/collection1/ has no replicas
[junit4:junit4] 2> 993066 T2381 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47829/collection1/
[junit4:junit4] 2> 993066 T2381 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 994126 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 994171 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 994171 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 994171 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 994202 T2381 oasc.ZkController.register We are http://127.0.0.1:47829/collection1/ and leader is http://127.0.0.1:47829/collection1/
[junit4:junit4] 2> 994202 T2381 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47829
[junit4:junit4] 2> 994202 T2381 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 994202 T2381 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 994203 T2381 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 994205 T2381 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 994206 T2338 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 994206 T2338 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 994207 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 994486 T2338 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 994490 T2338 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:47010
[junit4:junit4] 2> 994490 T2338 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 994491 T2338 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 994492 T2338 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369262980636
[junit4:junit4] 2> 994492 T2338 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369262980636/solr.xml
[junit4:junit4] 2> 994493 T2338 oasc.CoreContainer.<init> New CoreContainer 68453167
[junit4:junit4] 2> 994493 T2338 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369262980636/'
[junit4:junit4] 2> 994494 T2338 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369262980636/'
[junit4:junit4] 2> 994623 T2338 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 994624 T2338 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 994625 T2338 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 994625 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 994626 T2338 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 994626 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 994627 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 994628 T2338 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 994628 T2338 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 994629 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 994646 T2338 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 994647 T2338 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50302/solr
[junit4:junit4] 2> 994648 T2338 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 994649 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 994652 T2394 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60d4ef27 name:ZooKeeperConnection Watcher:127.0.0.1:50302 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 994652 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 994654 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 994667 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 994669 T2396 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15e9c2be name:ZooKeeperConnection Watcher:127.0.0.1:50302/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 994669 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 994680 T2338 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 995684 T2338 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47010_
[junit4:junit4] 2> 995684 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 995686 T2338 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47010_
[junit4:junit4] 2> 995686 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47829_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47829"}
[junit4:junit4] 2> 995701 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 995701 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 995701 T2396 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 995703 T2380 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 995704 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 995704 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 995713 T2367 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 995714 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 995716 T2360 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 995716 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 995717 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 995720 T2397 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369262980636/collection1
[junit4:junit4] 2> 995720 T2397 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 995721 T2397 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 995721 T2397 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 995722 T2397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369262980636/collection1/'
[junit4:junit4] 2> 995724 T2397 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369262980636/collection1/lib/README' to classloader
[junit4:junit4] 2> 995725 T2397 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369262980636/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 995777 T2397 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 995837 T2397 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 995938 T2397 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 995944 T2397 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 996527 T2397 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 996531 T2397 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 996533 T2397 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 996538 T2397 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 996561 T2397 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 996562 T2397 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369262980636/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty2/
[junit4:junit4] 2> 996562 T2397 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38cc9aee
[junit4:junit4] 2> 996563 T2397 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 996563 T2397 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty2
[junit4:junit4] 2> 996564 T2397 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty2/index/
[junit4:junit4] 2> 996564 T2397 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 996565 T2397 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty2/index
[junit4:junit4] 2> 996568 T2397 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c89a4fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@313a58ac),segFN=segments_1,generation=1}
[junit4:junit4] 2> 996569 T2397 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 996572 T2397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 996572 T2397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 996573 T2397 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 996574 T2397 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 996575 T2397 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 996575 T2397 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 996575 T2397 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 996576 T2397 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 996576 T2397 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 996592 T2397 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 996599 T2397 oass.SolrIndexSearcher.<init> Opening Searcher@5f149350 main
[junit4:junit4] 2> 996600 T2397 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty2/tlog
[junit4:junit4] 2> 996601 T2397 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 996601 T2397 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 996606 T2398 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5f149350 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 996608 T2397 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 996609 T2397 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 997217 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 997218 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47010_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47010"}
[junit4:junit4] 2> 997218 T2361 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 997219 T2361 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 997231 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 997231 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 997231 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 997231 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 997611 T2397 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 997611 T2397 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47010 collection:collection1 shard:shard2
[junit4:junit4] 2> 997612 T2397 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 997622 T2397 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 997624 T2397 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 997625 T2397 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 997625 T2397 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47010/collection1/
[junit4:junit4] 2> 997625 T2397 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 997626 T2397 oasc.SyncStrategy.syncToMe http://127.0.0.1:47010/collection1/ has no replicas
[junit4:junit4] 2> 997626 T2397 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47010/collection1/
[junit4:junit4] 2> 997626 T2397 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 998735 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 998767 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 998767 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 998767 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 998767 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 998804 T2397 oasc.ZkController.register We are http://127.0.0.1:47010/collection1/ and leader is http://127.0.0.1:47010/collection1/
[junit4:junit4] 2> 998804 T2397 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47010
[junit4:junit4] 2> 998804 T2397 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 998805 T2397 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 998805 T2397 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 998807 T2397 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 998808 T2338 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 998809 T2338 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 998810 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 999088 T2338 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 999091 T2338 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:27207
[junit4:junit4] 2> 999092 T2338 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 999093 T2338 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 999093 T2338 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369262985238
[junit4:junit4] 2> 999094 T2338 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369262985238/solr.xml
[junit4:junit4] 2> 999094 T2338 oasc.CoreContainer.<init> New CoreContainer 1898142949
[junit4:junit4] 2> 999095 T2338 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369262985238/'
[junit4:junit4] 2> 999096 T2338 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369262985238/'
[junit4:junit4] 2> 999225 T2338 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 999226 T2338 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 999226 T2338 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 999227 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 999227 T2338 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 999228 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 999228 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 999229 T2338 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 999229 T2338 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 999230 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 999247 T2338 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 999248 T2338 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50302/solr
[junit4:junit4] 2> 999249 T2338 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 999250 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 999253 T2410 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7addb958 name:ZooKeeperConnection Watcher:127.0.0.1:50302 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 999253 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 999256 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 999268 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 999270 T2412 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e60ddc9 name:ZooKeeperConnection Watcher:127.0.0.1:50302/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 999271 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 999281 T2338 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1000280 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1000281 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47010_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47010"}
[junit4:junit4] 2> 1000285 T2338 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:27207_
[junit4:junit4] 2> 1000297 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1000297 T2412 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1000297 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1000297 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1000297 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1000299 T2338 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:27207_
[junit4:junit4] 2> 1000308 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1000308 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1000308 T2412 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1000309 T2360 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1000308 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1000309 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1000309 T2412 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1000310 T2367 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1000309 T2396 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1000311 T2380 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1000316 T2413 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369262985238/collection1
[junit4:junit4] 2> 1000316 T2413 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1000317 T2413 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1000317 T2413 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1000319 T2413 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369262985238/collection1/'
[junit4:junit4] 2> 1000320 T2413 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369262985238/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1000321 T2413 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369262985238/collection1/lib/README' to classloader
[junit4:junit4] 2> 1000374 T2413 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1000434 T2413 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1000535 T2413 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1000541 T2413 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1001119 T2413 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1001123 T2413 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1001125 T2413 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1001130 T2413 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1001152 T2413 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1001153 T2413 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369262985238/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/
[junit4:junit4] 2> 1001153 T2413 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38cc9aee
[junit4:junit4] 2> 1001154 T2413 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1001154 T2413 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3
[junit4:junit4] 2> 1001155 T2413 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index/
[junit4:junit4] 2> 1001155 T2413 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1001156 T2413 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index
[junit4:junit4] 2> 1001159 T2413 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4699ea0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@64ec863e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1001159 T2413 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1001163 T2413 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1001163 T2413 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1001164 T2413 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1001164 T2413 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1001165 T2413 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1001165 T2413 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1001166 T2413 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1001166 T2413 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1001167 T2413 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1001182 T2413 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1001189 T2413 oass.SolrIndexSearcher.<init> Opening Searcher@3d10086e main
[junit4:junit4] 2> 1001190 T2413 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/tlog
[junit4:junit4] 2> 1001191 T2413 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1001191 T2413 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1001195 T2414 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d10086e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1001197 T2413 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1001197 T2413 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1001803 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1001804 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:27207_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27207"}
[junit4:junit4] 2> 1001804 T2361 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1001805 T2361 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1001819 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1001819 T2412 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1001819 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1001819 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1001819 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1002200 T2413 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1002200 T2413 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:27207 collection:collection1 shard:shard1
[junit4:junit4] 2> 1002203 T2413 oasc.ZkController.register We are http://127.0.0.1:27207/collection1/ and leader is http://127.0.0.1:47829/collection1/
[junit4:junit4] 2> 1002204 T2413 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:27207
[junit4:junit4] 2> 1002204 T2413 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1002204 T2413 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1881 name=collection1 org.apache.solr.core.SolrCore@67e6695f url=http://127.0.0.1:27207/collection1 node=127.0.0.1:27207_ C1881_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:27207_, base_url=http://127.0.0.1:27207}
[junit4:junit4] 2> 1002205 T2415 C1881 P27207 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1002205 T2413 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1002206 T2415 C1881 P27207 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1002207 T2415 C1881 P27207 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1002207 T2415 C1881 P27207 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1002207 T2338 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1002208 T2338 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1002208 T2415 C1881 P27207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1002209 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1002234 T2370 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1002501 T2338 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1002505 T2338 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:33684
[junit4:junit4] 2> 1002506 T2338 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1002506 T2338 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1002507 T2338 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369262988643
[junit4:junit4] 2> 1002507 T2338 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369262988643/solr.xml
[junit4:junit4] 2> 1002508 T2338 oasc.CoreContainer.<init> New CoreContainer 680391401
[junit4:junit4] 2> 1002509 T2338 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369262988643/'
[junit4:junit4] 2> 1002509 T2338 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369262988643/'
[junit4:junit4] 2> 1002646 T2338 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1002647 T2338 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1002647 T2338 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1002648 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1002648 T2338 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1002649 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1002650 T2338 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1002650 T2338 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1002651 T2338 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1002651 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1002670 T2338 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1002670 T2338 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50302/solr
[junit4:junit4] 2> 1002671 T2338 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1002672 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1002675 T2427 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@183e000b name:ZooKeeperConnection Watcher:127.0.0.1:50302 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1002676 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1002678 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1002689 T2338 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1002691 T2429 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a14921a name:ZooKeeperConnection Watcher:127.0.0.1:50302/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1002692 T2338 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1002703 T2338 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1003323 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1003324 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:27207_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27207"}
[junit4:junit4] 2> 1003355 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1003355 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1003355 T2412 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1003355 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1003355 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1003355 T2429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1003707 T2338 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33684_
[junit4:junit4] 2> 1003712 T2338 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33684_
[junit4:junit4] 2> 1003728 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1003728 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1003728 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1003729 T2429 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1003729 T2360 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1003729 T2412 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1003730 T2380 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1003730 T2412 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1003730 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1003730 T2429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1003731 T2367 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1003731 T2396 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1003736 T2430 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369262988643/collection1
[junit4:junit4] 2> 1003737 T2430 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1003737 T2430 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1003738 T2430 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1003739 T2430 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369262988643/collection1/'
[junit4:junit4] 2> 1003741 T2430 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369262988643/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1003741 T2430 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369262988643/collection1/lib/README' to classloader
[junit4:junit4] 2> 1003794 T2430 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 1003854 T2430 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1003955 T2430 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1003961 T2430 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1004236 T2370 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1004236 T2370 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:27207_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 1004544 T2430 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1004548 T2430 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1004551 T2430 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1004556 T2430 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1004578 T2430 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1004579 T2430 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369262988643/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4/
[junit4:junit4] 2> 1004579 T2430 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38cc9aee
[junit4:junit4] 2> 1004580 T2430 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1004581 T2430 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4
[junit4:junit4] 2> 1004581 T2430 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4/index/
[junit4:junit4] 2> 1004581 T2430 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1004582 T2430 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4/index
[junit4:junit4] 2> 1004586 T2430 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3d813aaa lockFactory=org.apache.lucene.store.NativeFSLockFactory@53f41fe9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1004586 T2430 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1004590 T2430 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1004590 T2430 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1004591 T2430 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1004592 T2430 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1004593 T2430 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1004593 T2430 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1004593 T2430 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1004594 T2430 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1004595 T2430 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1004612 T2430 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1004620 T2430 oass.SolrIndexSearcher.<init> Opening Searcher@668a2c0b main
[junit4:junit4] 2> 1004621 T2430 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4/tlog
[junit4:junit4] 2> 1004622 T2430 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1004622 T2430 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1004627 T2431 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@668a2c0b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1004629 T2430 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1004629 T2430 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1004868 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1004869 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33684_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33684"}
[junit4:junit4] 2> 1004869 T2361 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1004870 T2361 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1004884 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1004884 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1004884 T2412 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1004884 T2429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1004884 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1004884 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1005637 T2430 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1005637 T2430 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33684 collection:collection1 shard:shard2
[junit4:junit4] 2> 1005640 T2430 oasc.ZkController.register We are http://127.0.0.1:33684/collection1/ and leader is http://127.0.0.1:47010/collection1/
[junit4:junit4] 2> 1005641 T2430 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33684
[junit4:junit4] 2> 1005641 T2430 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1005641 T2430 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1882 name=collection1 org.apache.solr.core.SolrCore@5111b767 url=http://127.0.0.1:33684/collection1 node=127.0.0.1:33684_ C1882_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:33684_, base_url=http://127.0.0.1:33684}
[junit4:junit4] 2> 1005643 T2432 C1882 P33684 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1005643 T2430 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1005643 T2432 C1882 P33684 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1005644 T2432 C1882 P33684 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1005644 T2432 C1882 P33684 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1005644 T2338 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1005645 T2338 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1005645 T2432 C1882 P33684 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1005646 T2338 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1005669 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1005670 T2386 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1005671 T2338 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1005671 T2338 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1005672 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C1883 name=collection1 org.apache.solr.core.SolrCore@67e6695f url=http://127.0.0.1:27207/collection1 node=127.0.0.1:27207_ C1883_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:27207_, base_url=http://127.0.0.1:27207}
[junit4:junit4] 2> 1006238 T2415 C1883 P27207 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:47829/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1006238 T2415 C1883 P27207 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:27207 START replicas=[http://127.0.0.1:47829/collection1/] nUpdates=100
[junit4:junit4] 2> 1006239 T2415 C1883 P27207 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1006240 T2415 C1883 P27207 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1006240 T2415 C1883 P27207 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1006240 T2415 C1883 P27207 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1006241 T2415 C1883 P27207 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1006241 T2415 C1883 P27207 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:47829/collection1/. core=collection1
[junit4:junit4] 2> 1006241 T2415 C1883 P27207 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1884 name=collection1 org.apache.solr.core.SolrCore@14a5b350 url=http://127.0.0.1:47829/collection1 node=127.0.0.1:47829_ C1884_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:47829_, base_url=http://127.0.0.1:47829, leader=true}
[junit4:junit4] 2> 1006249 T2371 C1884 P47829 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1006253 T2372 C1884 P47829 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1006258 T2372 C1884 P47829 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@348b90c8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76402c9b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1006258 T2372 C1884 P47829 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1006259 T2372 C1884 P47829 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@348b90c8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76402c9b),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@348b90c8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76402c9b),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1006260 T2372 C1884 P47829 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1006260 T2372 C1884 P47829 oass.SolrIndexSearcher.<init> Opening Searcher@544160b3 realtime
[junit4:junit4] 2> 1006261 T2372 C1884 P47829 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1006261 T2372 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1006262 T2415 C1883 P27207 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1006262 T2415 C1883 P27207 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1006265 T2373 C1884 P47829 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1006266 T2373 C1884 P47829 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1006266 T2415 C1883 P27207 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1006267 T2415 C1883 P27207 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1006267 T2415 C1883 P27207 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1006270 T2373 C1884 P47829 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1006271 T2415 C1883 P27207 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1006272 T2415 C1883 P27207 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index.20130522174952682
[junit4:junit4] 2> 1006272 T2415 C1883 P27207 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@aed98fb lockFactory=org.apache.lucene.store.NativeFSLockFactory@69de31f1) fullCopy=false
[junit4:junit4] 2> 1006275 T2373 C1884 P47829 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1006276 T2415 C1883 P27207 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1006277 T2415 C1883 P27207 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1006277 T2415 C1883 P27207 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1006280 T2415 C1883 P27207 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4699ea0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@64ec863e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4699ea0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@64ec863e),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1006280 T2415 C1883 P27207 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1006281 T2415 C1883 P27207 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1006281 T2415 C1883 P27207 oass.SolrIndexSearcher.<init> Opening Searcher@24c86cfe main
[junit4:junit4] 2> 1006282 T2414 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@24c86cfe main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1006283 T2415 C1883 P27207 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index.20130522174952682 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index.20130522174952682;done=true>>]
[junit4:junit4] 2> 1006283 T2415 C1883 P27207 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index.20130522174952682
[junit4:junit4] 2> 1006284 T2415 C1883 P27207 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index.20130522174952682
[junit4:junit4] 2> 1006284 T2415 C1883 P27207 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1006284 T2415 C1883 P27207 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1006284 T2415 C1883 P27207 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1006285 T2415 C1883 P27207 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1006286 T2415 C1883 P27207 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1006388 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1006389 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33684_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33684"}
[junit4:junit4] 2> 1006404 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:27207_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:27207"}
[junit4:junit4] 2> 1006416 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1006416 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1006416 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1006416 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1006416 T2429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1006416 T2412 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1006672 T2386 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1006672 T2386 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:33684_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 1006674 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1007676 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C1882_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:33684_, base_url=http://127.0.0.1:33684}
[junit4:junit4] 2> 1008674 T2432 C1882 P33684 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:47010/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1008674 T2432 C1882 P33684 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:33684 START replicas=[http://127.0.0.1:47010/collection1/] nUpdates=100
[junit4:junit4] 2> 1008675 T2432 C1882 P33684 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1008675 T2432 C1882 P33684 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1008675 T2432 C1882 P33684 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1008675 T2432 C1882 P33684 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1008676 T2432 C1882 P33684 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1008676 T2432 C1882 P33684 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:47010/collection1/. core=collection1
[junit4:junit4] 2> 1008676 T2432 C1882 P33684 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1008678 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C1885 name=collection1 org.apache.solr.core.SolrCore@7ccea77b url=http://127.0.0.1:47010/collection1 node=127.0.0.1:47010_ C1885_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:47010_, base_url=http://127.0.0.1:47010, leader=true}
[junit4:junit4] 2> 1008684 T2387 C1885 P47010 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1008690 T2388 C1885 P47010 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1008694 T2388 C1885 P47010 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c89a4fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@313a58ac),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1008694 T2388 C1885 P47010 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1008695 T2388 C1885 P47010 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c89a4fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@313a58ac),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c89a4fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@313a58ac),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1008696 T2388 C1885 P47010 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1008696 T2388 C1885 P47010 oass.SolrIndexSearcher.<init> Opening Searcher@18dce068 realtime
[junit4:junit4] 2> 1008697 T2388 C1885 P47010 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1008697 T2388 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1008698 T2432 C1882 P33684 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1008699 T2432 C1882 P33684 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1008701 T2389 C1885 P47010 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1008701 T2389 C1885 P47010 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1008702 T2432 C1882 P33684 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1008702 T2432 C1882 P33684 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1008702 T2432 C1882 P33684 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1008704 T2389 C1885 P47010 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1008705 T2432 C1882 P33684 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1008706 T2432 C1882 P33684 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4/index.20130522174955116
[junit4:junit4] 2> 1008706 T2432 C1882 P33684 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@520a76a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fce53be) fullCopy=false
[junit4:junit4] 2> 1008709 T2389 C1885 P47010 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1008710 T2432 C1882 P33684 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1008712 T2432 C1882 P33684 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1008712 T2432 C1882 P33684 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1008714 T2432 C1882 P33684 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3d813aaa lockFactory=org.apache.lucene.store.NativeFSLockFactory@53f41fe9),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3d813aaa lockFactory=org.apache.lucene.store.NativeFSLockFactory@53f41fe9),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1008714 T2432 C1882 P33684 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1008715 T2432 C1882 P33684 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1008715 T2432 C1882 P33684 oass.SolrIndexSearcher.<init> Opening Searcher@64e33331 main
[junit4:junit4] 2> 1008716 T2431 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@64e33331 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1008717 T2432 C1882 P33684 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4/index.20130522174955116 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4/index.20130522174955116;done=true>>]
[junit4:junit4] 2> 1008717 T2432 C1882 P33684 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4/index.20130522174955116
[junit4:junit4] 2> 1008717 T2432 C1882 P33684 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty4/index.20130522174955116
[junit4:junit4] 2> 1008718 T2432 C1882 P33684 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1008718 T2432 C1882 P33684 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1008718 T2432 C1882 P33684 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1008718 T2432 C1882 P33684 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1008721 T2432 C1882 P33684 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1009431 T2361 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1009432 T2361 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33684_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33684"}
[junit4:junit4] 2> 1009447 T2412 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1009447 T2367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1009447 T2396 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1009447 T2429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1009447 T2360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1009447 T2380 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1009680 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1009682 T2338 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C1886 name=collection1 org.apache.solr.core.SolrCore@73bed508 url=http://127.0.0.1:39132/collection1 node=127.0.0.1:39132_ C1886_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:39132_, base_url=http://127.0.0.1:39132, leader=true}
[junit4:junit4] 2> 1009690 T2350 C1886 P39132 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1009694 T2350 C1886 P39132 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61c8275b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6909edda),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1009695 T2350 C1886 P39132 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1009696 T2350 C1886 P39132 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61c8275b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6909edda),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61c8275b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6909edda),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1009696 T2350 C1886 P39132 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1009697 T2350 C1886 P39132 oass.SolrIndexSearcher.<init> Opening Searcher@5c7bf2e2 main
[junit4:junit4] 2> 1009697 T2350 C1886 P39132 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1009698 T2364 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5c7bf2e2 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1009699 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 1009711 T2374 C1884 P47829 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1009712 T2374 C1884 P47829 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@348b90c8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76402c9b),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@348b90c8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@76402c9b),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1009713 T2374 C1884 P47829 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1009714 T2374 C1884 P47829 oass.SolrIndexSearcher.<init> Opening Searcher@2d610bcb main
[junit4:junit4] 2> 1009714 T2374 C1884 P47829 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1009715 T2382 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d610bcb main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1009715 T2374 C1884 P47829 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:27207/collection1/, StdNode: http://127.0.0.1:47010/collection1/, StdNode: http://127.0.0.1:33684/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1009718 T2390 C1885 P47010 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1009720 T2390 C1885 P47010 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c89a4fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@313a58ac),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c89a4fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@313a58ac),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1009720 T2390 C1885 P47010 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1009721 T2390 C1885 P47010 oass.SolrIndexSearcher.<init> Opening Searcher@7cc50d91 main
[junit4:junit4] 2> 1009721 T2390 C1885 P47010 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1009722 T2398 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7cc50d91 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1009723 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C1883_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:27207_, base_url=http://127.0.0.1:27207}
[junit4:junit4] 2> 1009726 T2402 C1883 P27207 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C1882_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:33684_, base_url=http://127.0.0.1:33684}
[junit4:junit4] 2> 1009726 T2419 C1882 P33684 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1009727 T2402 C1883 P27207 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4699ea0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@64ec863e),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4699ea0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@64ec863e),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1009728 T2419 C1882 P33684 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3d813aaa lockFactory=org.apache.lucene.store.NativeFSLockFactory@53f41fe9),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3d813aaa lockFactory=org.apache.lucene.store.NativeFSLockFactory@53f41fe9),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1009728 T2402 C1883 P27207 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1009728 T2419 C1882 P33684 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1009729 T2402 C1883 P27207 oass.SolrIndexSearcher.<init> Opening Searcher@2c518cb main
[junit4:junit4] 2> 1009730 T2419 C1882 P33684 oass.SolrIndexSearcher.<init> Opening Searcher@79247cad main
[junit4:junit4] 2> 1009730 T2402 C1883 P27207 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1009731 T2414 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c518cb main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1009731 T2419 C1882 P33684 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1009732 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1009731 T2431 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@79247cad main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1009733 T2419 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1009733 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 1009734 T2338 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1009737 T2375 C1884 P47829 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1009739 T2403 C1883 P27207 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1009740 T2391 C1885 P47010 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1009742 T2420 C1882 P33684 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1011747 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435776317554425856)} 0 2
[junit4:junit4] 2> 1011754 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435776317559668736&update.from=http://127.0.0.1:47829/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435776317559668736)} 0 1
[junit4:junit4] 2> 1011758 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435776317562814464&update.from=http://127.0.0.1:47010/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435776317562814464)} 0 1
[junit4:junit4] 2> 1011759 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435776317562814464)} 0 6
[junit4:junit4] 2> 1011760 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435776317559668736)} 0 10
[junit4:junit4] 2> 1011763 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1435776317572251648)]} 0 1
[junit4:junit4] 2> 1011771 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435776317578543104)]} 0 0
[junit4:junit4] 2> 1011772 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1435776317578543104)]} 0 4
[junit4:junit4] 2> 1011773 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0]} 0 7
[junit4:junit4] 2> 1011775 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435776317585883136)]} 0 0
[junit4:junit4] 2> 1011780 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435776317589028864)]} 0 0
[junit4:junit4] 2> 1011781 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435776317589028864)]} 0 3
[junit4:junit4] 2> 1011783 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435776317594271744)]} 0 0
[junit4:junit4] 2> 1011788 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435776317597417472)]} 0 0
[junit4:junit4] 2> 1011789 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435776317597417472)]} 0 3
[junit4:junit4] 2> 1011791 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435776317602660352)]} 0 0
[junit4:junit4] 2> 1011795 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435776317604757504)]} 0 0
[junit4:junit4] 2> 1011796 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435776317604757504)]} 0 3
[junit4:junit4] 2> 1011798 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435776317610000384)]} 0 0
[junit4:junit4] 2> 1011805 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435776317615243264)]} 0 0
[junit4:junit4] 2> 1011806 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1435776317615243264)]} 0 3
[junit4:junit4] 2> 1011806 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4]} 0 5
[junit4:junit4] 2> 1011809 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435776317621534720)]} 0 0
[junit4:junit4] 2> 1011816 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435776317626777600)]} 0 0
[junit4:junit4] 2> 1011817 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1435776317626777600)]} 0 3
[junit4:junit4] 2> 1011818 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5]} 0 6
[junit4:junit4] 2> 1011820 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1435776317633069056)]} 0 0
[junit4:junit4] 2> 1011825 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435776317636214784)]} 0 0
[junit4:junit4] 2> 1011826 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1435776317636214784)]} 0 3
[junit4:junit4] 2> 1011828 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435776317641457664)]} 0 0
[junit4:junit4] 2> 1011833 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435776317644603392)]} 0 0
[junit4:junit4] 2> 1011834 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435776317644603392)]} 0 3
[junit4:junit4] 2> 1011837 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435776317650894848)]} 0 0
[junit4:junit4] 2> 1011843 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435776317655089152)]} 0 0
[junit4:junit4] 2> 1011844 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!8 (1435776317655089152)]} 0 3
[junit4:junit4] 2> 1011845 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8]} 0 5
[junit4:junit4] 2> 1011847 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435776317661380608)]} 0 0
[junit4:junit4] 2> 1011854 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435776317666623488)]} 0 0
[junit4:junit4] 2> 1011855 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!9 (1435776317666623488)]} 0 3
[junit4:junit4] 2> 1011856 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9]} 0 6
[junit4:junit4] 2> 1011858 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1435776317672914944)]} 0 0
[junit4:junit4] 2> 1011863 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435776317676060672)]} 0 0
[junit4:junit4] 2> 1011864 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1435776317676060672)]} 0 3
[junit4:junit4] 2> 1011867 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435776317682352128)]} 0 0
[junit4:junit4] 2> 1011872 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435776317685497856)]} 0 0
[junit4:junit4] 2> 1011873 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435776317685497856)]} 0 3
[junit4:junit4] 2> 1011876 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435776317691789312)]} 0 0
[junit4:junit4] 2> 1011883 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435776317697032192)]} 0 0
[junit4:junit4] 2> 1011884 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1435776317697032192)]} 0 3
[junit4:junit4] 2> 1011884 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12]} 0 5
[junit4:junit4] 2> 1011887 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435776317703323648)]} 0 0
[junit4:junit4] 2> 1011894 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435776317708566528)]} 0 0
[junit4:junit4] 2> 1011895 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1435776317708566528)]} 0 3
[junit4:junit4] 2> 1011895 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13]} 0 5
[junit4:junit4] 2> 1011898 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435776317714857984)]} 0 0
[junit4:junit4] 2> 1011903 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435776317718003712)]} 0 0
[junit4:junit4] 2> 1011904 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435776317718003712)]} 0 3
[junit4:junit4] 2> 1011907 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435776317724295168)]} 0 0
[junit4:junit4] 2> 1011914 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435776317729538048)]} 0 0
[junit4:junit4] 2> 1011915 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!15 (1435776317729538048)]} 0 3
[junit4:junit4] 2> 1011915 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15]} 0 5
[junit4:junit4] 2> 1011918 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435776317735829504)]} 0 0
[junit4:junit4] 2> 1011925 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435776317741072384)]} 0 0
[junit4:junit4] 2> 1011926 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1435776317741072384)]} 0 3
[junit4:junit4] 2> 1011926 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16]} 0 5
[junit4:junit4] 2> 1011929 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435776317747363840)]} 0 0
[junit4:junit4] 2> 1011934 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435776317750509568)]} 0 0
[junit4:junit4] 2> 1011935 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435776317750509568)]} 0 3
[junit4:junit4] 2> 1011938 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1435776317756801024)]} 0 0
[junit4:junit4] 2> 1011945 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435776317762043904)]} 0 0
[junit4:junit4] 2> 1011946 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1435776317762043904)]} 0 3
[junit4:junit4] 2> 1011946 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18]} 0 5
[junit4:junit4] 2> 1011949 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435776317768335360)]} 0 0
[junit4:junit4] 2> 1011954 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435776317771481088)]} 0 0
[junit4:junit4] 2> 1011955 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435776317771481088)]} 0 3
[junit4:junit4] 2> 1011957 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1435776317776723968)]} 0 0
[junit4:junit4] 2> 1011965 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435776317783015424)]} 0 0
[junit4:junit4] 2> 1011966 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1435776317783015424)]} 0 3
[junit4:junit4] 2> 1011966 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 5
[junit4:junit4] 2> 1011969 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435776317789306880)]} 0 0
[junit4:junit4] 2> 1011976 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435776317794549760)]} 0 0
[junit4:junit4] 2> 1011977 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!21 (1435776317794549760)]} 0 3
[junit4:junit4] 2> 1011977 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21]} 0 5
[junit4:junit4] 2> 1011980 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435776317800841216)]} 0 0
[junit4:junit4] 2> 1011987 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435776317806084096)]} 0 0
[junit4:junit4] 2> 1011988 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!22 (1435776317806084096)]} 0 3
[junit4:junit4] 2> 1011989 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22]} 0 6
[junit4:junit4] 2> 1011992 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435776317813424128)]} 0 0
[junit4:junit4] 2> 1011997 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435776317816569856)]} 0 0
[junit4:junit4] 2> 1011998 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435776317816569856)]} 0 3
[junit4:junit4] 2> 1012001 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1435776317822861312)]} 0 0
[junit4:junit4] 2> 1012008 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435776317828104192)]} 0 0
[junit4:junit4] 2> 1012009 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1435776317828104192)]} 0 3
[junit4:junit4] 2> 1012009 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24]} 0 5
[junit4:junit4] 2> 1012012 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435776317834395648)]} 0 0
[junit4:junit4] 2> 1012019 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435776317839638528)]} 0 0
[junit4:junit4] 2> 1012020 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1435776317839638528)]} 0 3
[junit4:junit4] 2> 1012020 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25]} 0 5
[junit4:junit4] 2> 1012023 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435776317845929984)]} 0 0
[junit4:junit4] 2> 1012028 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435776317849075712)]} 0 0
[junit4:junit4] 2> 1012029 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435776317849075712)]} 0 3
[junit4:junit4] 2> 1012031 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1435776317854318592)]} 0 0
[junit4:junit4] 2> 1012039 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435776317859561472)]} 0 0
[junit4:junit4] 2> 1012040 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1435776317859561472)]} 0 4
[junit4:junit4] 2> 1012041 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 7
[junit4:junit4] 2> 1012043 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435776317866901504)]} 0 0
[junit4:junit4] 2> 1012048 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435776317870047232)]} 0 0
[junit4:junit4] 2> 1012049 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435776317870047232)]} 0 3
[junit4:junit4] 2> 1012051 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1435776317875290112)]} 0 0
[junit4:junit4] 2> 1012058 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435776317880532992)]} 0 0
[junit4:junit4] 2> 1012059 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1435776317880532992)]} 0 3
[junit4:junit4] 2> 1012060 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29]} 0 6
[junit4:junit4] 2> 1012063 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435776317886824448)]} 0 1
[junit4:junit4] 2> 1012070 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435776317893115904)]} 0 0
[junit4:junit4] 2> 1012071 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!30 (1435776317893115904)]} 0 3
[junit4:junit4] 2> 1012072 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30]} 0 6
[junit4:junit4] 2> 1012074 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435776317899407360)]} 0 0
[junit4:junit4] 2> 1012081 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435776317904650240)]} 0 0
[junit4:junit4] 2> 1012082 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1435776317904650240)]} 0 3
[junit4:junit4] 2> 1012083 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31]} 0 6
[junit4:junit4] 2> 1012085 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435776317910941696)]} 0 0
[junit4:junit4] 2> 1012092 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435776317916184576)]} 0 0
[junit4:junit4] 2> 1012093 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!32 (1435776317916184576)]} 0 3
[junit4:junit4] 2> 1012093 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32]} 0 5
[junit4:junit4] 2> 1012096 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1435776317922476032)]} 0 0
[junit4:junit4] 2> 1012103 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435776317927718912)]} 0 0
[junit4:junit4] 2> 1012104 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1435776317927718912)]} 0 3
[junit4:junit4] 2> 1012104 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33]} 0 5
[junit4:junit4] 2> 1012107 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435776317934010368)]} 0 0
[junit4:junit4] 2> 1012114 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435776317939253248)]} 0 0
[junit4:junit4] 2> 1012115 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1435776317939253248)]} 0 3
[junit4:junit4] 2> 1012115 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34]} 0 5
[junit4:junit4] 2> 1012118 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435776317945544704)]} 0 0
[junit4:junit4] 2> 1012124 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435776317948690432)]} 0 0
[junit4:junit4] 2> 1012125 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435776317948690432)]} 0 4
[junit4:junit4] 2> 1012127 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435776317954981888)]} 0 0
[junit4:junit4] 2> 1012134 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1435776317960224768)]} 0 0
[junit4:junit4] 2> 1012135 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1435776317960224768)]} 0 3
[junit4:junit4] 2> 1012135 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36]} 0 5
[junit4:junit4] 2> 1012138 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1435776317966516224)]} 0 0
[junit4:junit4] 2> 1012145 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1435776317971759104)]} 0 0
[junit4:junit4] 2> 1012146 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1435776317971759104)]} 0 3
[junit4:junit4] 2> 1012147 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37]} 0 6
[junit4:junit4] 2> 1012149 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435776317978050560)]} 0 0
[junit4:junit4] 2> 1012154 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1435776317981196288)]} 0 0
[junit4:junit4] 2> 1012155 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435776317981196288)]} 0 3
[junit4:junit4] 2> 1012157 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1435776317986439168)]} 0 0
[junit4:junit4] 2> 1012164 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1435776317991682048)]} 0 0
[junit4:junit4] 2> 1012165 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1435776317991682048)]} 0 3
[junit4:junit4] 2> 1012165 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39]} 0 5
[junit4:junit4] 2> 1012168 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435776317997973504)]} 0 0
[junit4:junit4] 2> 1012173 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1435776318001119232)]} 0 0
[junit4:junit4] 2> 1012174 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435776318001119232)]} 0 3
[junit4:junit4] 2> 1012177 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1435776318007410688)]} 0 0
[junit4:junit4] 2> 1012184 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1435776318012653568)]} 0 0
[junit4:junit4] 2> 1012185 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!41 (1435776318012653568)]} 0 3
[junit4:junit4] 2> 1012185 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41]} 0 5
[junit4:junit4] 2> 1012188 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435776318018945024)]} 0 0
[junit4:junit4] 2> 1012195 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1435776318024187904)]} 0 0
[junit4:junit4] 2> 1012196 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!42 (1435776318024187904)]} 0 3
[junit4:junit4] 2> 1012196 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42]} 0 5
[junit4:junit4] 2> 1012199 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435776318030479360)]} 0 0
[junit4:junit4] 2> 1012207 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1435776318036770816)]} 0 0
[junit4:junit4] 2> 1012208 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!43 (1435776318036770816)]} 0 3
[junit4:junit4] 2> 1012208 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43]} 0 5
[junit4:junit4] 2> 1012211 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435776318043062272)]} 0 0
[junit4:junit4] 2> 1012219 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1435776318048305152)]} 0 0
[junit4:junit4] 2> 1012220 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!44 (1435776318048305152)]} 0 4
[junit4:junit4] 2> 1012221 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44]} 0 7
[junit4:junit4] 2> 1012223 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435776318055645184)]} 0 0
[junit4:junit4] 2> 1012228 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1435776318058790912)]} 0 0
[junit4:junit4] 2> 1012229 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435776318058790912)]} 0 3
[junit4:junit4] 2> 1012232 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435776318065082368)]} 0 0
[junit4:junit4] 2> 1012238 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1435776318068228096)]} 0 0
[junit4:junit4] 2> 1012239 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435776318068228096)]} 0 4
[junit4:junit4] 2> 1012241 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1435776318074519552)]} 0 0
[junit4:junit4] 2> 1012248 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1435776318079762432)]} 0 0
[junit4:junit4] 2> 1012249 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1435776318079762432)]} 0 3
[junit4:junit4] 2> 1012249 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 5
[junit4:junit4] 2> 1012252 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435776318086053888)]} 0 0
[junit4:junit4] 2> 1012257 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1435776318089199616)]} 0 0
[junit4:junit4] 2> 1012258 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435776318089199616)]} 0 3
[junit4:junit4] 2> 1012260 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1435776318094442496)]} 0 0
[junit4:junit4] 2> 1012272 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1435776318102831104)]} 0 1
[junit4:junit4] 2> 1012273 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1435776318102831104)]} 0 5
[junit4:junit4] 2> 1012273 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49]} 0 10
[junit4:junit4] 2> 1012276 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435776318111219712)]} 0 0
[junit4:junit4] 2> 1012285 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1435776318114365440)]} 0 3
[junit4:junit4] 2> 1012285 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435776318114365440)]} 0 6
[junit4:junit4] 2> 1012288 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435776318123802624)]} 0 0
[junit4:junit4] 2> 1012293 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1435776318126948352)]} 0 0
[junit4:junit4] 2> 1012294 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435776318126948352)]} 0 3
[junit4:junit4] 2> 1012296 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435776318132191232)]} 0 0
[junit4:junit4] 2> 1012301 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1435776318135336960)]} 0 0
[junit4:junit4] 2> 1012302 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435776318135336960)]} 0 3
[junit4:junit4] 2> 1012304 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435776318140579840)]} 0 0
[junit4:junit4] 2> 1012311 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1435776318145822720)]} 0 0
[junit4:junit4] 2> 1012312 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1435776318145822720)]} 0 3
[junit4:junit4] 2> 1012312 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53]} 0 5
[junit4:junit4] 2> 1012315 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435776318152114176)]} 0 0
[junit4:junit4] 2> 1012322 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1435776318157357056)]} 0 0
[junit4:junit4] 2> 1012323 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!54 (1435776318157357056)]} 0 3
[junit4:junit4] 2> 1012323 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54]} 0 5
[junit4:junit4] 2> 1012326 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435776318163648512)]} 0 0
[junit4:junit4] 2> 1012333 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1435776318168891392)]} 0 0
[junit4:junit4] 2> 1012334 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1435776318168891392)]} 0 3
[junit4:junit4] 2> 1012335 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55]} 0 6
[junit4:junit4] 2> 1012337 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1435776318175182848)]} 0 0
[junit4:junit4] 2> 1012342 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1435776318178328576)]} 0 0
[junit4:junit4] 2> 1012343 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1435776318178328576)]} 0 3
[junit4:junit4] 2> 1012345 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435776318183571456)]} 0 0
[junit4:junit4] 2> 1012352 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1435776318188814336)]} 0 0
[junit4:junit4] 2> 1012353 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1435776318188814336)]} 0 3
[junit4:junit4] 2> 1012353 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57]} 0 5
[junit4:junit4] 2> 1012356 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435776318195105792)]} 0 0
[junit4:junit4] 2> 1012361 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1435776318198251520)]} 0 0
[junit4:junit4] 2> 1012362 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435776318198251520)]} 0 3
[junit4:junit4] 2> 1012364 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435776318203494400)]} 0 0
[junit4:junit4] 2> 1012369 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1435776318206640128)]} 0 0
[junit4:junit4] 2> 1012370 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435776318206640128)]} 0 3
[junit4:junit4] 2> 1012372 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1435776318211883008)]} 0 0
[junit4:junit4] 2> 1012377 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1435776318215028736)]} 0 0
[junit4:junit4] 2> 1012378 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1435776318215028736)]} 0 3
[junit4:junit4] 2> 1012380 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435776318220271616)]} 0 0
[junit4:junit4] 2> 1012387 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1435776318225514496)]} 0 0
[junit4:junit4] 2> 1012388 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!61 (1435776318225514496)]} 0 3
[junit4:junit4] 2> 1012388 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61]} 0 5
[junit4:junit4] 2> 1012391 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435776318231805952)]} 0 0
[junit4:junit4] 2> 1012398 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1435776318237048832)]} 0 0
[junit4:junit4] 2> 1012399 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!62 (1435776318237048832)]} 0 3
[junit4:junit4] 2> 1012399 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62]} 0 5
[junit4:junit4] 2> 1012402 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1435776318243340288)]} 0 0
[junit4:junit4] 2> 1012409 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1435776318248583168)]} 0 0
[junit4:junit4] 2> 1012410 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!63 (1435776318248583168)]} 0 3
[junit4:junit4] 2> 1012410 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63]} 0 5
[junit4:junit4] 2> 1012413 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1435776318254874624)]} 0 0
[junit4:junit4] 2> 1012420 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1435776318260117504)]} 0 0
[junit4:junit4] 2> 1012421 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!64 (1435776318260117504)]} 0 3
[junit4:junit4] 2> 1012421 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64]} 0 5
[junit4:junit4] 2> 1012424 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435776318266408960)]} 0 0
[junit4:junit4] 2> 1012431 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1435776318271651840)]} 0 0
[junit4:junit4] 2> 1012432 T2376 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!65 (1435776318271651840)]} 0 3
[junit4:junit4] 2> 1012432 T2392 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65]} 0 5
[junit4:junit4] 2> 1012435 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1435776318277943296)]} 0 0
[junit4:junit4] 2> 1012442 T2421 C1882 P33684 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47010/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1435776318283186176)]} 0 0
[junit4:junit4] 2> 1012443 T2390 C1885 P47010 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1435776318283186176)]} 0 3
[junit4:junit4] 2> 1012443 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66]} 0 5
[junit4:junit4] 2> 1012446 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1435776318289477632)]} 0 0
[junit4:junit4] 2> 1012451 T2402 C1883 P27207 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47829/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1435776318292623360)]} 0 0
[junit4:junit4] 2> 1012452 T2374 C1884 P47829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1435776318292623360)]} 0 3
[junit4:junit4] 2> 1012454 T2350 C1886 P39132 oasup.LogUpdateProcessor.finish [collect
[...truncated too long message...]
t4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1022460 T2338 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 1022601 T2429 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1022601 T2429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1022601 T2429 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1048068 T2412 oasu.PeerSync.handleResponse WARN PeerSync: core=collection1 url=http://127.0.0.1:27207 couldn't connect to http://127.0.0.1:47829/collection1/, counting as success
[junit4:junit4] 2> 1048068 T2412 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:27207 DONE. sync succeeded
[junit4:junit4] 2> 1048069 T2412 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1048069 T2412 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4:junit4] 2> 1048070 T2412 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@67e6695f
[junit4:junit4] 2> 1048071 T2412 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=10,adds=10,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=69,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1048071 T2412 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1048071 T2412 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1048072 T2412 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> ASYNC NEW_CORE C1901 name=collection1 org.apache.solr.core.SolrCore@67e6695f url=http://127.0.0.1:27207/collection1 node=127.0.0.1:27207_ C1901_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:27207_, base_url=http://127.0.0.1:27207}
[junit4:junit4] 2> 1048073 T2412 C1901 P27207 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4699ea0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@64ec863e),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4699ea0b lockFactory=org.apache.lucene.store.NativeFSLockFactory@64ec863e),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1048074 T2412 C1901 P27207 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1048077 T2412 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1048077 T2412 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1048077 T2412 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3;done=false>>]
[junit4:junit4] 2> 1048078 T2412 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3
[junit4:junit4] 2> 1048078 T2412 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index;done=false>>]
[junit4:junit4] 2> 1048078 T2412 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369262972245/jetty3/index
[junit4:junit4] 2> 1048079 T2412 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1048079 T2412 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1048079 T2412 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1048079 T2412 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1048080 T2412 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1048080 T2412 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=222), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=222)), sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=pt_PT, timezone=America/Matamoros
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=94905872,total=368050176
[junit4:junit4] 2> NOTE: All tests run in this JVM: [SortByFunctionTest, ZkNodePropsTest, PluginInfoTest, BasicDistributedZkTest, TestSchemaResource, TestStressVersions, TestUniqueKeyFieldResource, ShowFileRequestHandlerTest, NotRequiredUniqueKeyTest, TestConfig, QueryEqualityTest, PreAnalyzedUpdateProcessorTest, QueryElevationComponentTest, ChaosMonkeyShardSplitTest, IndexReaderFactoryTest, AnalysisAfterCoreReloadTest, PrimitiveFieldTypeTest, TestSuggestSpellingConverter, LeaderElectionTest, ZkControllerTest, SuggesterTSTTest, TestStressRecovery, TestFieldTypeResource, TermVectorComponentTest, SolrCoreCheckLockOnStartupTest, ZkSolrClientTest, BadCopyFieldTest, TestSolrDeletionPolicy1, TestDefaultSimilarityFactory, TestCloudManagedSchemaAddField, TestSolrQueryParserDefaultOperatorResource, BasicDistributedZk2Test, TestJmxIntegration, TestCoreDiscovery, SpellCheckCollatorTest, TestQuerySenderNoQuery, TestRecovery, CopyFieldTest, CurrencyFieldXmlFileTest, DateFieldTest, DocValuesTest, XsltUpdateRequestHandlerTest, TestFastOutputStream, TestCollationKeyRangeQueries, TestRTGBase, TestOmitPositions, PeerSyncTest, LoggingHandlerTest, StatelessScriptUpdateProcessorFactoryTest, TestRandomFaceting, TestLMDirichletSimilarityFactory, TestZkChroot, SpellingQueryConverterTest, SolrRequestParserTest, TestQuerySenderListener, OpenCloseCoreStressTest, TestFieldTypeCollectionResource, SynonymTokenizerTest, UpdateRequestProcessorFactoryTest, OpenExchangeRatesOrgProviderTest, TestBadConfig, DebugComponentTest, DirectSolrConnectionTest, DirectUpdateHandlerOptimizeTest, CurrencyFieldOpenExchangeTest, TestPostingsSolrHighlighter, TestSolr4Spatial, RequestHandlersTest, TestRangeQuery, BadComponentTest, SystemInfoHandlerTest, ShardSplitTest]
[junit4:junit4] Completed on J0 in 62.68s, 1 test, 1 error <<< FAILURES!
[...truncated 467 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:386: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:366: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 13 ignored (7 assumptions)
Total time: 50 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1274 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1274/
2 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:23084 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:23084 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([1C035AE934BA8D5C:9DE5D4F143E5ED60]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:44418 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:44418 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([1C035AE934BA8D5C:9DE5D4F143E5ED60]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9401 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 556438 T1148 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 556445 T1148 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1369239514620
[junit4:junit4] 2> 556447 T1148 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 556448 T1149 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 556549 T1148 oasc.ZkTestServer.run start zk server on port:47718
[junit4:junit4] 2> 556550 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 556554 T1155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b7edba5 name:ZooKeeperConnection Watcher:127.0.0.1:47718 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 556555 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 556555 T1148 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 556567 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 556570 T1157 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@107eab3d name:ZooKeeperConnection Watcher:127.0.0.1:47718/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 556570 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 556571 T1148 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 556580 T1148 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 556584 T1148 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 556586 T1148 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 556595 T1148 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 556596 T1148 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 556609 T1148 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 556609 T1148 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 556740 T1148 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 556741 T1148 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 556745 T1148 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 556745 T1148 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 556749 T1148 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 556750 T1148 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 556753 T1148 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 556754 T1148 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 556757 T1148 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 556758 T1148 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 556761 T1148 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 556762 T1148 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 556765 T1148 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 556766 T1148 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 557036 T1148 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 557041 T1148 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:12371
[junit4:junit4] 2> 557041 T1148 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 557042 T1148 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 557042 T1148 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369239514949
[junit4:junit4] 2> 557043 T1148 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369239514949/solr.xml
[junit4:junit4] 2> 557043 T1148 oasc.CoreContainer.<init> New CoreContainer 589514731
[junit4:junit4] 2> 557044 T1148 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369239514949/'
[junit4:junit4] 2> 557045 T1148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369239514949/'
[junit4:junit4] 2> 557173 T1148 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 557173 T1148 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 557174 T1148 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 557175 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 557175 T1148 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 557176 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 557176 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 557177 T1148 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 557177 T1148 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 557178 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 557196 T1148 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 557197 T1148 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:47718/solr
[junit4:junit4] 2> 557198 T1148 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 557199 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 557228 T1168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73768a3a name:ZooKeeperConnection Watcher:127.0.0.1:47718 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 557229 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 557257 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 557271 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 557273 T1170 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17b84560 name:ZooKeeperConnection Watcher:127.0.0.1:47718/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 557273 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 557275 T1148 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 557299 T1148 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 557303 T1148 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 557306 T1148 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:12371_
[junit4:junit4] 2> 557307 T1148 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:12371_
[junit4:junit4] 2> 557318 T1148 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 557332 T1148 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 557335 T1148 oasc.Overseer.start Overseer (id=89734480830595075-127.0.0.1:12371_-n_0000000000) starting
[junit4:junit4] 2> 557340 T1148 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 557353 T1172 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 557354 T1148 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 557357 T1148 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 557364 T1148 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 557367 T1171 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 557371 T1173 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369239514949/collection1
[junit4:junit4] 2> 557372 T1173 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 557372 T1173 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 557373 T1173 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 557374 T1173 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369239514949/collection1/'
[junit4:junit4] 2> 557376 T1173 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1369239514949/collection1/lib/README' to classloader
[junit4:junit4] 2> 557376 T1173 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1369239514949/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 557428 T1173 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 557489 T1173 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 557591 T1173 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 557597 T1173 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 558180 T1173 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 558184 T1173 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 558186 T1173 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 558192 T1173 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 558226 T1173 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 558226 T1173 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369239514949/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369239514619/control/data/
[junit4:junit4] 2> 558227 T1173 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71edd8a0
[junit4:junit4] 2> 558227 T1173 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 558230 T1173 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/control/data
[junit4:junit4] 2> 558230 T1173 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369239514619/control/data/index/
[junit4:junit4] 2> 558231 T1173 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369239514619/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 558231 T1173 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/control/data/index
[junit4:junit4] 2> 558236 T1173 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3bb492e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fc1ad2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 558236 T1173 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 558239 T1173 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 558239 T1173 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 558240 T1173 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 558241 T1173 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 558241 T1173 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 558241 T1173 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 558242 T1173 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 558242 T1173 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 558243 T1173 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 558259 T1173 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 558267 T1173 oass.SolrIndexSearcher.<init> Opening Searcher@115fb935 main
[junit4:junit4] 2> 558267 T1173 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369239514619/control/data/tlog
[junit4:junit4] 2> 558269 T1173 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 558269 T1173 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 558272 T1174 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@115fb935 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 558274 T1173 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 558275 T1173 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 558871 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 558872 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12371_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12371"}
[junit4:junit4] 2> 558872 T1171 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 558872 T1171 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 558887 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 559277 T1173 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 559277 T1173 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:12371 collection:control_collection shard:shard1
[junit4:junit4] 2> 559278 T1173 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 559300 T1173 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 559312 T1173 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 559312 T1173 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 559312 T1173 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:12371/collection1/
[junit4:junit4] 2> 559312 T1173 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 559313 T1173 oasc.SyncStrategy.syncToMe http://127.0.0.1:12371/collection1/ has no replicas
[junit4:junit4] 2> 559313 T1173 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:12371/collection1/
[junit4:junit4] 2> 559313 T1173 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 560393 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 560415 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 560463 T1173 oasc.ZkController.register We are http://127.0.0.1:12371/collection1/ and leader is http://127.0.0.1:12371/collection1/
[junit4:junit4] 2> 560463 T1173 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:12371
[junit4:junit4] 2> 560463 T1173 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 560463 T1173 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 560464 T1173 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 560466 T1173 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 560467 T1148 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 560468 T1148 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 560468 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 560485 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 560487 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 560489 T1177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40fea6d name:ZooKeeperConnection Watcher:127.0.0.1:47718/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 560489 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 560491 T1148 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 560494 T1148 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 560753 T1148 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 560756 T1148 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:23084
[junit4:junit4] 2> 560757 T1148 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 560757 T1148 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 560758 T1148 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369239518667
[junit4:junit4] 2> 560758 T1148 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369239518667/solr.xml
[junit4:junit4] 2> 560759 T1148 oasc.CoreContainer.<init> New CoreContainer 1292405582
[junit4:junit4] 2> 560760 T1148 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369239518667/'
[junit4:junit4] 2> 560760 T1148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369239518667/'
[junit4:junit4] 2> 560888 T1148 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 560888 T1148 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 560889 T1148 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 560889 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 560890 T1148 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 560890 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 560891 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 560891 T1148 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 560892 T1148 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 560892 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 560909 T1148 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 560910 T1148 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:47718/solr
[junit4:junit4] 2> 560910 T1148 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 560911 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 560915 T1188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3dcac94d name:ZooKeeperConnection Watcher:127.0.0.1:47718 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 560915 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 560929 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 560941 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 560943 T1190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@393dc74c name:ZooKeeperConnection Watcher:127.0.0.1:47718/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 560943 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 560955 T1148 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 561931 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 561932 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:12371__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:12371_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:12371"}
[junit4:junit4] 2> 561951 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 561951 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 561951 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 561959 T1148 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23084_
[junit4:junit4] 2> 561961 T1148 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:23084_
[junit4:junit4] 2> 561964 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 561964 T1177 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 561964 T1170 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 561964 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 561965 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 561966 T1190 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 561973 T1191 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369239518667/collection1
[junit4:junit4] 2> 561973 T1191 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 561974 T1191 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 561974 T1191 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 561976 T1191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369239518667/collection1/'
[junit4:junit4] 2> 561977 T1191 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1369239518667/collection1/lib/README' to classloader
[junit4:junit4] 2> 561978 T1191 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1369239518667/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 562033 T1191 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 562094 T1191 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 562197 T1191 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 562204 T1191 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 562775 T1191 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 562779 T1191 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 562782 T1191 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 562787 T1191 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 562822 T1191 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 562822 T1191 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369239518667/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty1/
[junit4:junit4] 2> 562823 T1191 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71edd8a0
[junit4:junit4] 2> 562823 T1191 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 562825 T1191 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty1
[junit4:junit4] 2> 562826 T1191 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty1/index/
[junit4:junit4] 2> 562826 T1191 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 562827 T1191 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty1/index
[junit4:junit4] 2> 562831 T1191 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7f8721e8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@187f67f),segFN=segments_1,generation=1}
[junit4:junit4] 2> 562831 T1191 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 562834 T1191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 562835 T1191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 562835 T1191 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 562836 T1191 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 562837 T1191 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 562837 T1191 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 562838 T1191 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 562838 T1191 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 562839 T1191 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 562855 T1191 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 562863 T1191 oass.SolrIndexSearcher.<init> Opening Searcher@78387d36 main
[junit4:junit4] 2> 562863 T1191 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty1/tlog
[junit4:junit4] 2> 562864 T1191 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 562865 T1191 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 562870 T1192 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@78387d36 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 562872 T1191 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 562872 T1191 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 563457 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 563458 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:23084_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:23084"}
[junit4:junit4] 2> 563458 T1171 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 563458 T1171 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 563499 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 563499 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 563499 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 563902 T1191 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 563902 T1191 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:23084 collection:collection1 shard:shard1
[junit4:junit4] 2> 563903 T1191 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 563928 T1191 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 563939 T1191 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 563939 T1191 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 563939 T1191 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:23084/collection1/
[junit4:junit4] 2> 563940 T1191 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 563940 T1191 oasc.SyncStrategy.syncToMe http://127.0.0.1:23084/collection1/ has no replicas
[junit4:junit4] 2> 563940 T1191 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:23084/collection1/
[junit4:junit4] 2> 563941 T1191 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 565005 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 565027 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 565027 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 565027 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 565034 T1191 oasc.ZkController.register We are http://127.0.0.1:23084/collection1/ and leader is http://127.0.0.1:23084/collection1/
[junit4:junit4] 2> 565034 T1191 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:23084
[junit4:junit4] 2> 565034 T1191 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 565034 T1191 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 565035 T1191 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 565036 T1191 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 565038 T1148 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 565038 T1148 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 565039 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 565317 T1148 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 565321 T1148 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:36618
[junit4:junit4] 2> 565321 T1148 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 565322 T1148 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 565322 T1148 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369239523229
[junit4:junit4] 2> 565323 T1148 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369239523229/solr.xml
[junit4:junit4] 2> 565323 T1148 oasc.CoreContainer.<init> New CoreContainer 759407196
[junit4:junit4] 2> 565324 T1148 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369239523229/'
[junit4:junit4] 2> 565325 T1148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369239523229/'
[junit4:junit4] 2> 565452 T1148 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 565453 T1148 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 565454 T1148 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 565454 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 565455 T1148 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 565455 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 565456 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 565456 T1148 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 565457 T1148 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 565457 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 565476 T1148 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 565477 T1148 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:47718/solr
[junit4:junit4] 2> 565477 T1148 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 565478 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 565482 T1204 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4237ae95 name:ZooKeeperConnection Watcher:127.0.0.1:47718 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 565482 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 565496 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 565509 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 565511 T1206 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7feb21cf name:ZooKeeperConnection Watcher:127.0.0.1:47718/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 565512 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 565522 T1148 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 566527 T1148 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36618_
[junit4:junit4] 2> 566529 T1148 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36618_
[junit4:junit4] 2> 566532 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 566533 T1177 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 566533 T1206 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 566533 T1170 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 566534 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566534 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566535 T1190 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 566543 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 566544 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:23084__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:23084_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:23084"}
[junit4:junit4] 2> 566548 T1207 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369239523229/collection1
[junit4:junit4] 2> 566549 T1207 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 566553 T1207 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 566553 T1207 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 566554 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566554 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566554 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566555 T1207 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369239523229/collection1/'
[junit4:junit4] 2> 566557 T1207 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1369239523229/collection1/lib/README' to classloader
[junit4:junit4] 2> 566557 T1207 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1369239523229/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 566558 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 566621 T1207 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 566681 T1207 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 566783 T1207 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 566790 T1207 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 567364 T1207 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 567368 T1207 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 567371 T1207 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 567376 T1207 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 567411 T1207 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 567412 T1207 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369239523229/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty2/
[junit4:junit4] 2> 567412 T1207 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71edd8a0
[junit4:junit4] 2> 567413 T1207 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 567415 T1207 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty2
[junit4:junit4] 2> 567416 T1207 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty2/index/
[junit4:junit4] 2> 567416 T1207 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 567417 T1207 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty2/index
[junit4:junit4] 2> 567421 T1207 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c3d1e2a lockFactory=org.apache.lucene.store.NativeFSLockFactory@df8e760),segFN=segments_1,generation=1}
[junit4:junit4] 2> 567422 T1207 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 567425 T1207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 567426 T1207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 567427 T1207 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 567427 T1207 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 567428 T1207 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 567428 T1207 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 567429 T1207 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 567429 T1207 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 567430 T1207 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 567446 T1207 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 567454 T1207 oass.SolrIndexSearcher.<init> Opening Searcher@4541cca4 main
[junit4:junit4] 2> 567455 T1207 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty2/tlog
[junit4:junit4] 2> 567456 T1207 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 567456 T1207 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 567461 T1208 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4541cca4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 567463 T1207 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 567464 T1207 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 568061 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 568062 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:36618_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36618"}
[junit4:junit4] 2> 568062 T1171 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 568062 T1171 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 568067 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 568067 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 568067 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 568067 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 568467 T1207 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 568467 T1207 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36618 collection:collection1 shard:shard2
[junit4:junit4] 2> 568468 T1207 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 568488 T1207 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 568491 T1207 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 568492 T1207 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 568492 T1207 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36618/collection1/
[junit4:junit4] 2> 568492 T1207 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 568492 T1207 oasc.SyncStrategy.syncToMe http://127.0.0.1:36618/collection1/ has no replicas
[junit4:junit4] 2> 568493 T1207 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36618/collection1/
[junit4:junit4] 2> 568493 T1207 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 569591 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 569616 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 569616 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 569616 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 569616 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 569630 T1207 oasc.ZkController.register We are http://127.0.0.1:36618/collection1/ and leader is http://127.0.0.1:36618/collection1/
[junit4:junit4] 2> 569630 T1207 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36618
[junit4:junit4] 2> 569630 T1207 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 569630 T1207 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 569631 T1207 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 569632 T1207 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 569634 T1148 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 569634 T1148 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 569635 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 569911 T1148 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 569915 T1148 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:25347
[junit4:junit4] 2> 569916 T1148 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 569916 T1148 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 569917 T1148 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369239527825
[junit4:junit4] 2> 569917 T1148 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369239527825/solr.xml
[junit4:junit4] 2> 569918 T1148 oasc.CoreContainer.<init> New CoreContainer 822642785
[junit4:junit4] 2> 569918 T1148 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369239527825/'
[junit4:junit4] 2> 569919 T1148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369239527825/'
[junit4:junit4] 2> 570046 T1148 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 570046 T1148 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 570047 T1148 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 570047 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 570048 T1148 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 570048 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 570049 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 570049 T1148 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 570050 T1148 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 570050 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 570067 T1148 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 570068 T1148 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:47718/solr
[junit4:junit4] 2> 570069 T1148 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 570070 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 570073 T1220 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24eeaa8a name:ZooKeeperConnection Watcher:127.0.0.1:47718 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 570073 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 570088 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 570100 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 570102 T1222 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42fd1445 name:ZooKeeperConnection Watcher:127.0.0.1:47718/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 570103 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 570114 T1148 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 571118 T1148 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25347_
[junit4:junit4] 2> 571121 T1148 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25347_
[junit4:junit4] 2> 571124 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 571124 T1222 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 571124 T1177 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 571125 T1206 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 571125 T1170 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 571125 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571125 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571125 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571126 T1190 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 571129 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 571130 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:36618__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:36618_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36618"}
[junit4:junit4] 2> 571132 T1223 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369239527825/collection1
[junit4:junit4] 2> 571133 T1223 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 571134 T1223 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 571134 T1223 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 571135 T1222 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571136 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571135 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571136 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571135 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 571137 T1223 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369239527825/collection1/'
[junit4:junit4] 2> 571138 T1223 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1369239527825/collection1/lib/README' to classloader
[junit4:junit4] 2> 571139 T1223 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1369239527825/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 571192 T1223 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 571252 T1223 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 571354 T1223 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 571361 T1223 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 571938 T1223 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 571942 T1223 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 571945 T1223 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 571950 T1223 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 571984 T1223 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 571985 T1223 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369239527825/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3/
[junit4:junit4] 2> 571985 T1223 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71edd8a0
[junit4:junit4] 2> 571986 T1223 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 571988 T1223 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3
[junit4:junit4] 2> 571989 T1223 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3/index/
[junit4:junit4] 2> 571989 T1223 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 571990 T1223 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3/index
[junit4:junit4] 2> 571993 T1223 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eb3d168 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fa94cc1),segFN=segments_1,generation=1}
[junit4:junit4] 2> 571994 T1223 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 571997 T1223 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 571997 T1223 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 571998 T1223 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 571999 T1223 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 572000 T1223 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 572000 T1223 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 572001 T1223 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 572002 T1223 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 572002 T1223 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 572019 T1223 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 572027 T1223 oass.SolrIndexSearcher.<init> Opening Searcher@4374bc49 main
[junit4:junit4] 2> 572028 T1223 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3/tlog
[junit4:junit4] 2> 572029 T1223 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 572029 T1223 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 572034 T1224 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4374bc49 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 572037 T1223 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 572037 T1223 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 572648 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 572649 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25347_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25347"}
[junit4:junit4] 2> 572649 T1171 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 572649 T1171 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 572690 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 572690 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 572690 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 572690 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 572690 T1222 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 573040 T1223 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 573040 T1223 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:25347 collection:collection1 shard:shard1
[junit4:junit4] 2> 573044 T1223 oasc.ZkController.register We are http://127.0.0.1:25347/collection1/ and leader is http://127.0.0.1:23084/collection1/
[junit4:junit4] 2> 573044 T1223 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:25347
[junit4:junit4] 2> 573045 T1223 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 573045 T1223 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C296 name=collection1 org.apache.solr.core.SolrCore@48f6492b url=http://127.0.0.1:25347/collection1 node=127.0.0.1:25347_ C296_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:25347_, base_url=http://127.0.0.1:25347}
[junit4:junit4] 2> 573045 T1225 C296 P25347 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 573046 T1223 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 573046 T1225 C296 P25347 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 573047 T1225 C296 P25347 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 573047 T1225 C296 P25347 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 573048 T1148 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 573048 T1148 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 573049 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 573049 T1225 C296 P25347 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 573076 T1180 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:25347__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 573333 T1148 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 573336 T1148 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58505
[junit4:junit4] 2> 573337 T1148 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 573338 T1148 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 573338 T1148 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369239531247
[junit4:junit4] 2> 573339 T1148 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369239531247/solr.xml
[junit4:junit4] 2> 573339 T1148 oasc.CoreContainer.<init> New CoreContainer 371714021
[junit4:junit4] 2> 573340 T1148 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369239531247/'
[junit4:junit4] 2> 573341 T1148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369239531247/'
[junit4:junit4] 2> 573467 T1148 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 573468 T1148 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 573468 T1148 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 573469 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 573469 T1148 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 573470 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 573470 T1148 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 573471 T1148 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 573471 T1148 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 573472 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 573490 T1148 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 573491 T1148 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:47718/solr
[junit4:junit4] 2> 573491 T1148 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 573492 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 573496 T1237 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ec6379b name:ZooKeeperConnection Watcher:127.0.0.1:47718 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 573497 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 573511 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 573524 T1148 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 573527 T1239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d5fa85f name:ZooKeeperConnection Watcher:127.0.0.1:47718/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 573527 T1148 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 573539 T1148 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 574197 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 574198 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:25347__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25347_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25347"}
[junit4:junit4] 2> 574239 T1222 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 574240 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 574240 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 574240 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 574240 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 574240 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 574543 T1148 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58505_
[junit4:junit4] 2> 574546 T1148 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58505_
[junit4:junit4] 2> 574548 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 574548 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 574548 T1222 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 574549 T1170 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 574549 T1206 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 574549 T1177 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 574550 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 574549 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 574550 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 574550 T1190 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 574551 T1239 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 574558 T1222 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 574564 T1240 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369239531247/collection1
[junit4:junit4] 2> 574564 T1240 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 574565 T1240 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 574565 T1240 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 574567 T1240 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369239531247/collection1/'
[junit4:junit4] 2> 574568 T1240 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1369239531247/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 574569 T1240 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1369239531247/collection1/lib/README' to classloader
[junit4:junit4] 2> 574620 T1240 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 574679 T1240 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 574781 T1240 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 574788 T1240 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 575080 T1180 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:25347__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 575080 T1180 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:25347__collection1&state=recovering&nodeName=127.0.0.1:25347_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2004
[junit4:junit4] 2> 575347 T1240 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 575351 T1240 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 575353 T1240 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 575359 T1240 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 575390 T1240 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 575391 T1240 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369239531247/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4/
[junit4:junit4] 2> 575391 T1240 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71edd8a0
[junit4:junit4] 2> 575392 T1240 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 575394 T1240 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4
[junit4:junit4] 2> 575394 T1240 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4/index/
[junit4:junit4] 2> 575395 T1240 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 575395 T1240 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4/index
[junit4:junit4] 2> 575399 T1240 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13c9a489 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d5b2489),segFN=segments_1,generation=1}
[junit4:junit4] 2> 575399 T1240 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 575403 T1240 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 575403 T1240 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 575404 T1240 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 575405 T1240 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 575405 T1240 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 575405 T1240 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 575406 T1240 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 575406 T1240 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 575407 T1240 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 575423 T1240 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 575432 T1240 oass.SolrIndexSearcher.<init> Opening Searcher@b65a745 main
[junit4:junit4] 2> 575432 T1240 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4/tlog
[junit4:junit4] 2> 575434 T1240 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 575434 T1240 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 575438 T1241 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b65a745 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 575441 T1240 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 575441 T1240 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 575747 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 575748 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58505_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58505"}
[junit4:junit4] 2> 575748 T1171 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 575748 T1171 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 575763 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 575763 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 575763 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 575763 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 575763 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 575763 T1222 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 576445 T1240 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 576445 T1240 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58505 collection:collection1 shard:shard2
[junit4:junit4] 2> 576449 T1240 oasc.ZkController.register We are http://127.0.0.1:58505/collection1/ and leader is http://127.0.0.1:36618/collection1/
[junit4:junit4] 2> 576449 T1240 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58505
[junit4:junit4] 2> 576450 T1240 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 576450 T1240 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C297 name=collection1 org.apache.solr.core.SolrCore@797fe9a0 url=http://127.0.0.1:58505/collection1 node=127.0.0.1:58505_ C297_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:58505_, base_url=http://127.0.0.1:58505}
[junit4:junit4] 2> 576450 T1242 C297 P58505 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 576451 T1240 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 576451 T1242 C297 P58505 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 576452 T1242 C297 P58505 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 576452 T1242 C297 P58505 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 576453 T1148 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 576453 T1148 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 576454 T1242 C297 P58505 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 576454 T1148 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 576479 T1148 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 576480 T1196 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:58505__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 576481 T1148 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 576481 T1148 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 576482 T1148 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C298 name=collection1 org.apache.solr.core.SolrCore@48f6492b url=http://127.0.0.1:25347/collection1 node=127.0.0.1:25347_ C298_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:25347_, base_url=http://127.0.0.1:25347}
[junit4:junit4] 2> 577083 T1225 C298 P25347 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:23084/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 577083 T1225 C298 P25347 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:25347 START replicas=[http://127.0.0.1:23084/collection1/] nUpdates=100
[junit4:junit4] 2> 577084 T1225 C298 P25347 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 577085 T1225 C298 P25347 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 577085 T1225 C298 P25347 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 577085 T1225 C298 P25347 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 577085 T1225 C298 P25347 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 577086 T1225 C298 P25347 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:23084/collection1/. core=collection1
[junit4:junit4] 2> 577086 T1225 C298 P25347 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C299 name=collection1 org.apache.solr.core.SolrCore@4de67546 url=http://127.0.0.1:23084/collection1 node=127.0.0.1:23084_ C299_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:23084_, base_url=http://127.0.0.1:23084, leader=true}
[junit4:junit4] 2> 577093 T1181 C299 P23084 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 577099 T1182 C299 P23084 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 577102 T1182 C299 P23084 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7f8721e8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@187f67f),segFN=segments_1,generation=1}
[junit4:junit4] 2> 577103 T1182 C299 P23084 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 577104 T1182 C299 P23084 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7f8721e8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@187f67f),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7f8721e8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@187f67f),segFN=segments_2,generation=2}
[junit4:junit4] 2> 577104 T1182 C299 P23084 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 577105 T1182 C299 P23084 oass.SolrIndexSearcher.<init> Opening Searcher@1391cba8 realtime
[junit4:junit4] 2> 577105 T1182 C299 P23084 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 577106 T1182 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 577107 T1225 C298 P25347 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 577107 T1225 C298 P25347 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 577109 T1183 C299 P23084 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 577110 T1183 C299 P23084 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 577111 T1225 C298 P25347 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 577111 T1225 C298 P25347 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 577111 T1225 C298 P25347 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 577114 T1183 C299 P23084 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 577115 T1225 C298 P25347 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 577118 T1225 C298 P25347 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3/index.20130522221855289
[junit4:junit4] 2> 577118 T1225 C298 P25347 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/index50245030tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f6df019) fullCopy=false
[junit4:junit4] 2> 577122 T1183 C299 P23084 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 577124 T1225 C298 P25347 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 577126 T1225 C298 P25347 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 577126 T1225 C298 P25347 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 577129 T1225 C298 P25347 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eb3d168 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fa94cc1),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eb3d168 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fa94cc1),segFN=segments_2,generation=2}
[junit4:junit4] 2> 577129 T1225 C298 P25347 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 577130 T1225 C298 P25347 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 577130 T1225 C298 P25347 oass.SolrIndexSearcher.<init> Opening Searcher@7d4bf143 main
[junit4:junit4] 2> 577131 T1224 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7d4bf143 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 577132 T1225 C298 P25347 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3/index.20130522221855289 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3/index.20130522221855289;done=true>>]
[junit4:junit4] 2> 577132 T1225 C298 P25347 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3/index.20130522221855289
[junit4:junit4] 2> 577133 T1225 C298 P25347 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty3/index.20130522221855289
[junit4:junit4] 2> 577133 T1225 C298 P25347 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 577133 T1225 C298 P25347 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 577133 T1225 C298 P25347 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 577133 T1225 C298 P25347 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 577136 T1225 C298 P25347 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 577270 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 577271 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:58505__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58505_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58505"}
[junit4:junit4] 2> 577280 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:25347__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:25347_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:25347"}
[junit4:junit4] 2> 577295 T1222 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577295 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577296 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577295 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577295 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577295 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 577482 T1196 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:58505__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 577482 T1196 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:58505__collection1&state=recovering&nodeName=127.0.0.1:58505_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 577484 T1148 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 578487 T1148 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C297_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:58505_, base_url=http://127.0.0.1:58505}
[junit4:junit4] 2> 579485 T1242 C297 P58505 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:36618/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 579485 T1242 C297 P58505 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:58505 START replicas=[http://127.0.0.1:36618/collection1/] nUpdates=100
[junit4:junit4] 2> 579486 T1242 C297 P58505 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 579486 T1242 C297 P58505 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 579486 T1242 C297 P58505 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 579486 T1242 C297 P58505 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 579487 T1242 C297 P58505 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 579487 T1242 C297 P58505 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:36618/collection1/. core=collection1
[junit4:junit4] 2> 579487 T1242 C297 P58505 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 579490 T1148 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C300 name=collection1 org.apache.solr.core.SolrCore@76c07eb5 url=http://127.0.0.1:36618/collection1 node=127.0.0.1:36618_ C300_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:36618_, base_url=http://127.0.0.1:36618, leader=true}
[junit4:junit4] 2> 579499 T1197 C300 P36618 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 579506 T1198 C300 P36618 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 579509 T1198 C300 P36618 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c3d1e2a lockFactory=org.apache.lucene.store.NativeFSLockFactory@df8e760),segFN=segments_1,generation=1}
[junit4:junit4] 2> 579510 T1198 C300 P36618 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 579511 T1198 C300 P36618 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c3d1e2a lockFactory=org.apache.lucene.store.NativeFSLockFactory@df8e760),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c3d1e2a lockFactory=org.apache.lucene.store.NativeFSLockFactory@df8e760),segFN=segments_2,generation=2}
[junit4:junit4] 2> 579511 T1198 C300 P36618 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 579512 T1198 C300 P36618 oass.SolrIndexSearcher.<init> Opening Searcher@46ea96db realtime
[junit4:junit4] 2> 579512 T1198 C300 P36618 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 579513 T1198 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 579514 T1242 C297 P58505 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 579514 T1242 C297 P58505 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 579516 T1199 C300 P36618 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 579517 T1199 C300 P36618 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 579518 T1242 C297 P58505 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 579518 T1242 C297 P58505 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 579518 T1242 C297 P58505 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 579520 T1199 C300 P36618 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 579521 T1242 C297 P58505 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 579524 T1242 C297 P58505 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4/index.20130522221857695
[junit4:junit4] 2> 579524 T1242 C297 P58505 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.SimpleFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/index50245031tmp lockFactory=org.apache.lucene.store.NativeFSLockFactory@61dfeca4) fullCopy=false
[junit4:junit4] 2> 579527 T1199 C300 P36618 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 579529 T1242 C297 P58505 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 579531 T1242 C297 P58505 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 579531 T1242 C297 P58505 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 579533 T1242 C297 P58505 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13c9a489 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d5b2489),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13c9a489 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d5b2489),segFN=segments_2,generation=2}
[junit4:junit4] 2> 579534 T1242 C297 P58505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 579534 T1242 C297 P58505 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 579535 T1242 C297 P58505 oass.SolrIndexSearcher.<init> Opening Searcher@5fb1713e main
[junit4:junit4] 2> 579536 T1241 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5fb1713e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 579537 T1242 C297 P58505 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4/index.20130522221857695 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4/index.20130522221857695;done=true>>]
[junit4:junit4] 2> 579537 T1242 C297 P58505 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4/index.20130522221857695
[junit4:junit4] 2> 579537 T1242 C297 P58505 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369239514619/jetty4/index.20130522221857695
[junit4:junit4] 2> 579537 T1242 C297 P58505 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 579538 T1242 C297 P58505 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 579538 T1242 C297 P58505 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 579538 T1242 C297 P58505 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 579540 T1242 C297 P58505 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 580338 T1171 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 580339 T1171 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:58505__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58505_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58505"}
[junit4:junit4] 2> 580355 T1190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580355 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580355 T1206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580355 T1170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580355 T1239 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580355 T1222 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 580492 T1148 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 580494 T1148 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C301 name=collection1 org.apache.solr.core.SolrCore@13b6c9d5 url=http://127.0.0.1:12371/collection1 node=127.0.0.1:12371_ C301_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:12371_, base_url=http://127.0.0.1:12371, leader=true}
[junit4:junit4] 2> 580507 T1160 C301 P12371 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 580510 T1160 C301 P12371 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3bb492e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fc1ad2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 580511 T1160 C301 P12371 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 580512 T1160 C301 P12371 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3bb492e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fc1ad2),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3bb492e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fc1ad2),segFN=segments_2,generation=2}
[junit4:junit4] 2> 580512 T1160 C301 P12371 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 580513 T1160 C301 P12371 oass.SolrIndexSearcher.<init> Opening Searcher@7fcf060 main
[junit4:junit4] 2> 580514 T1160 C301 P12371 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 580514 T1174 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7fcf060 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 580515 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 580529 T1200 C300 P36618 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 580531 T1200 C300 P36618 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c3d1e2a lockFactory=org.apache.lucene.store.NativeFSLockFactory@df8e760),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7c3d1e2a lockFactory=org.apache.lucene.store.NativeFSLockFactory@df8e760),segFN=segments_3,generation=3}
[junit4:junit4] 2> 580532 T1200 C300 P36618 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 580532 T1200 C300 P36618 oass.SolrIndexSearcher.<init> Opening Searcher@77e1a7c3 main
[junit4:junit4] 2> 580533 T1200 C300 P36618 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 580534 T1208 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@77e1a7c3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 580534 T1200 C300 P36618 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:23084/collection1/, StdNode: http://127.0.0.1:25347/collection1/, StdNode: http://127.0.0.1:58505/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 580538 T1184 C299 P23084 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 580539 T1184 C299 P23084 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7f8721e8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@187f67f),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7f8721e8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@187f67f),segFN=segments_3,generation=3}
[junit4:junit4] 2> 580540 T1184 C299 P23084 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 580541 T1184 C299 P23084 oass.SolrIndexSearcher.<init> Opening Searcher@3523782d main
[junit4:junit4] 2> 580541 T1184 C299 P23084 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 580542 T1192 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3523782d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 580543 T1184 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C297_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58505_, base_url=http://127.0.0.1:58505}
[junit4:junit4] 2> 580545 T1229 C297 P58505 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C298_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:25347_, base_url=http://127.0.0.1:25347}
[junit4:junit4] 2> 580546 T1212 C298 P25347 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 580546 T1229 C297 P58505 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13c9a489 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d5b2489),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13c9a489 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d5b2489),segFN=segments_3,generation=3}
[junit4:junit4] 2> 580547 T1212 C298 P25347 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eb3d168 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fa94cc1),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eb3d168 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1fa94cc1),segFN=segments_3,generation=3}
[junit4:junit4] 2> 580547 T1229 C297 P58505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 580548 T1212 C298 P25347 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 580549 T1229 C297 P58505 oass.SolrIndexSearcher.<init> Opening Searcher@2963c6d6 main
[junit4:junit4] 2> 580550 T1229 C297 P58505 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 580550 T1212 C298 P25347 oass.SolrIndexSearcher.<init> Opening Searcher@216b8d11 main
[junit4:junit4] 2> 580551 T1241 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2963c6d6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 580551 T1212 C298 P25347 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 580551 T1229 C297 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 580552 T1224 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@216b8d11 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 580552 T1212 C298 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 580553 T1200 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 24
[junit4:junit4] 2> 580555 T1148 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 580558 T1185 C299 P23084 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 580560 T1213 C298 P25347 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 580562 T1201 C300 P36618 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 580564 T1230 C297 P58505 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 582571 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435751720674131968)} 0 2
[junit4:junit4] 2> 582581 T1229 C297 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435751720679374848&update.from=http://127.0.0.1:36618/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435751720679374848)} 0 2
[junit4:junit4] 2> 582585 T1214 C298 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435751720684617728&update.from=http://127.0.0.1:23084/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435751720684617728)} 0 1
[junit4:junit4] 2> 582586 T1184 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435751720684617728)} 0 7
[junit4:junit4] 2> 582587 T1200 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435751720679374848)} 0 12
[junit4:junit4] 2> 582600 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1435751720696152064)]} 0 9
[junit4:junit4] 2> 582608 T1229 C297 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435751720709783552)]} 0 1
[junit4:junit4] 2> 582609 T1200 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1435751720709783552)]} 0 5
[junit4:junit4] 2> 582613 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435751720718172160)]} 0 1
[junit4:junit4] 2> 582620 T1214 C298 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435751720721317888)]} 0 1
[junit4:junit4] 2> 582621 T1186 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435751720721317888)]} 0 6
[junit4:junit4] 2> 582626 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435751720731803648)]} 0 1
[junit4:junit4] 2> 582639 T1214 C298 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435751720741240832)]} 0 1
[junit4:junit4] 2> 582639 T1184 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1435751720741240832)]} 0 5
[junit4:junit4] 2> 582640 T1200 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2]} 0 10
[junit4:junit4] 2> 582645 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435751720751726592)]} 0 1
[junit4:junit4] 2> 582653 T1229 C297 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435751720755920896)]} 0 1
[junit4:junit4] 2> 582653 T1200 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435751720755920896)]} 0 5
[junit4:junit4] 2> 582657 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435751720764309504)]} 0 1
[junit4:junit4] 2> 582666 T1229 C297 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435751720770600960)]} 0 1
[junit4:junit4] 2> 582666 T1202 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1435751720770600960)]} 0 4
[junit4:junit4] 2> 582667 T1186 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4]} 0 7
[junit4:junit4] 2> 582672 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435751720780038144)]} 0 1
[junit4:junit4] 2> 582683 T1229 C297 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435751720787378176)]} 0 1
[junit4:junit4] 2> 582683 T1202 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1435751720787378176)]} 0 5
[junit4:junit4] 2> 582684 T1186 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5]} 0 9
[junit4:junit4] 2> 582688 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1435751720796815360)]} 0 1
[junit4:junit4] 2> 582699 T1214 C298 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435751720804155392)]} 0 1
[junit4:junit4] 2> 582700 T1184 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1435751720804155392)]} 0 6
[junit4:junit4] 2> 582700 T1200 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6]} 0 9
[junit4:junit4] 2> 582704 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435751720813592576)]} 0 1
[junit4:junit4] 2> 582716 T1214 C298 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435751720823029760)]} 0 1
[junit4:junit4] 2> 582716 T1184 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1435751720823029760)]} 0 4
[junit4:junit4] 2> 582717 T1200 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7]} 0 9
[junit4:junit4] 2> 582722 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435751720832466944)]} 0 1
[junit4:junit4] 2> 582730 T1214 C298 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435751720836661248)]} 0 1
[junit4:junit4] 2> 582730 T1186 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435751720836661248)]} 0 5
[junit4:junit4] 2> 582734 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435751720845049856)]} 0 1
[junit4:junit4] 2> 582741 T1214 C298 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435751720849244160)]} 0 1
[junit4:junit4] 2> 582741 T1186 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435751720849244160)]} 0 4
[junit4:junit4] 2> 582746 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1435751720857632768)]} 0 1
[junit4:junit4] 2> 582753 T1214 C298 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435751720861827072)]} 0 1
[junit4:junit4] 2> 582753 T1186 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1435751720861827072)]} 0 4
[junit4:junit4] 2> 582758 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435751720870215680)]} 0 1
[junit4:junit4] 2> 582770 T1229 C297 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435751720878604288)]} 0 1
[junit4:junit4] 2> 582770 T1202 C300 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1435751720878604288)]} 0 5
[junit4:junit4] 2> 582771 T1186 C299 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11]} 0 10
[junit4:junit4] 2> 582776 T1160 C301 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435751720889090048)]} 0 1
[junit4:junit4] 2> 582786 T1229 C297 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435751720895381504)]} 0 1
[junit4:junit4] 2> ASYNC NEW_CORE C302 name=collection1 org.apache.solr.core.SolrCore@76c07eb5 url=http://127.0.0.1:36618/collection1 node=127.0.0.1:36618_ C302_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:36618_, base_url=http://127.0.0.1:36618, leader=true}
[junit4:junit4] 2> 582801 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1435751720895381504)]} 0 20
[junit4:junit4] 2> ASYNC NEW_CORE C303 name=collection1 org.apache.solr.core.SolrCore@4de67546 url=http://127.0.0.1:23084/collection1 node=127.0.0.1:23084_ C303_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:23084_, base_url=http://127.0.0.1:23084, leader=true}
[junit4:junit4] 2> 582802 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12]} 0 24
[junit4:junit4] 2> ASYNC NEW_CORE C304 name=collection1 org.apache.solr.core.SolrCore@13b6c9d5 url=http://127.0.0.1:12371/collection1 node=127.0.0.1:12371_ C304_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:12371_, base_url=http://127.0.0.1:12371, leader=true}
[junit4:junit4] 2> 582806 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435751720921595904)]} 0 1
[junit4:junit4] 2> ASYNC NEW_CORE C305 name=collection1 org.apache.solr.core.SolrCore@48f6492b url=http://127.0.0.1:25347/collection1 node=127.0.0.1:25347_ C305_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:25347_, base_url=http://127.0.0.1:25347}
[junit4:junit4] 2> 582814 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435751720925790208)]} 0 1
[junit4:junit4] 2> 582815 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435751720925790208)]} 0 5
[junit4:junit4] 2> 582819 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435751720934178816)]} 0 1
[junit4:junit4] 2> ASYNC NEW_CORE C306 name=collection1 org.apache.solr.core.SolrCore@797fe9a0 url=http://127.0.0.1:58505/collection1 node=127.0.0.1:58505_ C306_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58505_, base_url=http://127.0.0.1:58505}
[junit4:junit4] 2> 582829 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435751720941518848)]} 0 1
[junit4:junit4] 2> 582829 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!14 (1435751720941518848)]} 0 4
[junit4:junit4] 2> 582830 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14]} 0 8
[junit4:junit4] 2> 582835 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435751720950956032)]} 0 1
[junit4:junit4] 2> 582842 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435751720955150336)]} 0 1
[junit4:junit4] 2> 582842 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435751720955150336)]} 0 4
[junit4:junit4] 2> 582846 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435751720962490368)]} 0 1
[junit4:junit4] 2> 582857 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435751720969830400)]} 0 1
[junit4:junit4] 2> 582857 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1435751720969830400)]} 0 5
[junit4:junit4] 2> 582858 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16]} 0 9
[junit4:junit4] 2> 582862 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435751720979267584)]} 0 1
[junit4:junit4] 2> 582869 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435751720983461888)]} 0 1
[junit4:junit4] 2> 582869 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435751720983461888)]} 0 4
[junit4:junit4] 2> 582873 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1435751720990801920)]} 0 1
[junit4:junit4] 2> 582880 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435751720993947648)]} 0 1
[junit4:junit4] 2> 582880 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1435751720993947648)]} 0 5
[junit4:junit4] 2> 582884 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435751721002336256)]} 0 1
[junit4:junit4] 2> 582891 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435751721006530560)]} 0 1
[junit4:junit4] 2> 582891 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435751721006530560)]} 0 4
[junit4:junit4] 2> 582896 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1435751721014919168)]} 0 1
[junit4:junit4] 2> 582906 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435751721022259200)]} 0 1
[junit4:junit4] 2> 582906 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1435751721022259200)]} 0 4
[junit4:junit4] 2> 582907 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 8
[junit4:junit4] 2> 582919 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435751721030647808)]} 0 9
[junit4:junit4] 2> 582927 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435751721044279296)]} 0 1
[junit4:junit4] 2> 582927 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435751721044279296)]} 0 4
[junit4:junit4] 2> 582932 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435751721052667904)]} 0 1
[junit4:junit4] 2> 582942 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435751721060007936)]} 0 1
[junit4:junit4] 2> 582942 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!22 (1435751721060007936)]} 0 4
[junit4:junit4] 2> 582943 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22]} 0 8
[junit4:junit4] 2> 582948 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435751721069445120)]} 0 1
[junit4:junit4] 2> 582959 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435751721076785152)]} 0 1
[junit4:junit4] 2> 582959 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1435751721076785152)]} 0 5
[junit4:junit4] 2> 582960 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23]} 0 9
[junit4:junit4] 2> 582964 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1435751721086222336)]} 0 1
[junit4:junit4] 2> 582974 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435751721093562368)]} 0 1
[junit4:junit4] 2> 582975 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1435751721093562368)]} 0 5
[junit4:junit4] 2> 582975 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24]} 0 9
[junit4:junit4] 2> 582979 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435751721101950976)]} 0 1
[junit4:junit4] 2> 582990 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435751721109291008)]} 0 1
[junit4:junit4] 2> 582990 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1435751721109291008)]} 0 5
[junit4:junit4] 2> 582991 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25]} 0 9
[junit4:junit4] 2> 582995 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435751721118728192)]} 0 1
[junit4:junit4] 2> 583007 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435751721127116800)]} 0 1
[junit4:junit4] 2> 583008 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!26 (1435751721127116800)]} 0 5
[junit4:junit4] 2> 583008 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26]} 0 10
[junit4:junit4] 2> 583012 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1435751721136553984)]} 0 1
[junit4:junit4] 2> 583019 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435751721140748288)]} 0 1
[junit4:junit4] 2> 583020 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1435751721140748288)]} 0 5
[junit4:junit4] 2> 583024 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435751721149136896)]} 0 1
[junit4:junit4] 2> 583034 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435751721156476928)]} 0 1
[junit4:junit4] 2> 583034 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1435751721156476928)]} 0 4
[junit4:junit4] 2> 583035 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 8
[junit4:junit4] 2> 583039 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1435751721164865536)]} 0 1
[junit4:junit4] 2> 583050 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435751721172205568)]} 0 1
[junit4:junit4] 2> 583050 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1435751721172205568)]} 0 5
[junit4:junit4] 2> 583051 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29]} 0 9
[junit4:junit4] 2> 583055 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435751721181642752)]} 0 1
[junit4:junit4] 2> 583063 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435751721186885632)]} 0 1
[junit4:junit4] 2> 583063 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435751721186885632)]} 0 4
[junit4:junit4] 2> 583068 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435751721195274240)]} 0 1
[junit4:junit4] 2> 583079 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435751721203662848)]} 0 1
[junit4:junit4] 2> 583079 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1435751721203662848)]} 0 4
[junit4:junit4] 2> 583080 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31]} 0 8
[junit4:junit4] 2> 583085 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435751721213100032)]} 0 1
[junit4:junit4] 2> 583094 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435751721219391488)]} 0 1
[junit4:junit4] 2> 583094 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!32 (1435751721219391488)]} 0 4
[junit4:junit4] 2> 583095 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32]} 0 8
[junit4:junit4] 2> 583100 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1435751721228828672)]} 0 1
[junit4:junit4] 2> 583107 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435751721231974400)]} 0 1
[junit4:junit4] 2> 583107 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1435751721231974400)]} 0 5
[junit4:junit4] 2> 583111 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435751721240363008)]} 0 1
[junit4:junit4] 2> 583120 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435751721246654464)]} 0 1
[junit4:junit4] 2> 583120 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1435751721246654464)]} 0 4
[junit4:junit4] 2> 583121 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34]} 0 8
[junit4:junit4] 2> 583126 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435751721256091648)]} 0 1
[junit4:junit4] 2> 583134 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435751721260285952)]} 0 1
[junit4:junit4] 2> 583135 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435751721260285952)]} 0 6
[junit4:junit4] 2> 583140 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435751721270771712)]} 0 1
[junit4:junit4] 2> 583151 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1435751721278111744)]} 0 1
[junit4:junit4] 2> 583152 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1435751721278111744)]} 0 6
[junit4:junit4] 2> 583152 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36]} 0 9
[junit4:junit4] 2> 583156 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1435751721287548928)]} 0 1
[junit4:junit4] 2> 583167 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1435751721295937536)]} 0 1
[junit4:junit4] 2> 583167 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1435751721295937536)]} 0 4
[junit4:junit4] 2> 583168 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37]} 0 8
[junit4:junit4] 2> 583172 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435751721304326144)]} 0 1
[junit4:junit4] 2> 583183 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1435751721312714752)]} 0 1
[junit4:junit4] 2> 583183 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!38 (1435751721312714752)]} 0 5
[junit4:junit4] 2> 583184 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38]} 0 9
[junit4:junit4] 2> 583188 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1435751721321103360)]} 0 1
[junit4:junit4] 2> 583198 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1435751721328443392)]} 0 1
[junit4:junit4] 2> 583198 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1435751721328443392)]} 0 4
[junit4:junit4] 2> 583199 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39]} 0 8
[junit4:junit4] 2> 583203 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435751721336832000)]} 0 1
[junit4:junit4] 2> 583212 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1435751721343123456)]} 0 1
[junit4:junit4] 2> 583213 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1435751721343123456)]} 0 5
[junit4:junit4] 2> 583213 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40]} 0 8
[junit4:junit4] 2> 583218 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1435751721352560640)]} 0 1
[junit4:junit4] 2> 583225 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1435751721356754944)]} 0 1
[junit4:junit4] 2> 583225 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1435751721356754944)]} 0 4
[junit4:junit4] 2> 583229 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435751721364094976)]} 0 1
[junit4:junit4] 2> 583241 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1435751721373532160)]} 0 1
[junit4:junit4] 2> 583241 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!42 (1435751721373532160)]} 0 4
[junit4:junit4] 2> 583242 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42]} 0 9
[junit4:junit4] 2> 583247 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435751721382969344)]} 0 1
[junit4:junit4] 2> 583255 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1435751721387163648)]} 0 1
[junit4:junit4] 2> 583255 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435751721387163648)]} 0 5
[junit4:junit4] 2> 583259 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435751721395552256)]} 0 1
[junit4:junit4] 2> 583269 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1435751721402892288)]} 0 1
[junit4:junit4] 2> 583269 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!44 (1435751721402892288)]} 0 4
[junit4:junit4] 2> 583270 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44]} 0 8
[junit4:junit4] 2> 583274 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435751721411280896)]} 0 1
[junit4:junit4] 2> 583282 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1435751721415475200)]} 0 1
[junit4:junit4] 2> 583282 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435751721415475200)]} 0 5
[junit4:junit4] 2> 583287 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435751721424912384)]} 0 1
[junit4:junit4] 2> 583294 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1435751721429106688)]} 0 1
[junit4:junit4] 2> 583294 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435751721429106688)]} 0 4
[junit4:junit4] 2> 583298 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1435751721436446720)]} 0 1
[junit4:junit4] 2> 583305 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1435751721440641024)]} 0 1
[junit4:junit4] 2> 583305 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1435751721440641024)]} 0 4
[junit4:junit4] 2> 583309 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435751721447981056)]} 0 1
[junit4:junit4] 2> 583319 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1435751721455321088)]} 0 1
[junit4:junit4] 2> 583320 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!48 (1435751721455321088)]} 0 5
[junit4:junit4] 2> 583320 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48]} 0 8
[junit4:junit4] 2> 583325 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1435751721464758272)]} 0 1
[junit4:junit4] 2> 583333 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1435751721468952576)]} 0 1
[junit4:junit4] 2> 583335 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1435751721468952576)]} 0 7
[junit4:junit4] 2> 583338 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435751721478389760)]} 0 1
[junit4:junit4] 2> 583349 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1435751721486778368)]} 0 1
[junit4:junit4] 2> 583350 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!50 (1435751721486778368)]} 0 6
[junit4:junit4] 2> 583351 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50]} 0 10
[junit4:junit4] 2> 583355 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435751721497264128)]} 0 1
[junit4:junit4] 2> 583362 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1435751721501458432)]} 0 1
[junit4:junit4] 2> 583363 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435751721501458432)]} 0 5
[junit4:junit4] 2> 583368 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435751721509847040)]} 0 1
[junit4:junit4] 2> 583375 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1435751721515089920)]} 0 1
[junit4:junit4] 2> 583376 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435751721515089920)]} 0 5
[junit4:junit4] 2> 583380 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435751721522429952)]} 0 1
[junit4:junit4] 2> 583388 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1435751721526624256)]} 0 1
[junit4:junit4] 2> 583389 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435751721526624256)]} 0 6
[junit4:junit4] 2> 583394 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435751721537110016)]} 0 1
[junit4:junit4] 2> 583402 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1435751721541304320)]} 0 1
[junit4:junit4] 2> 583403 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435751721541304320)]} 0 6
[junit4:junit4] 2> 583407 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435751721550741504)]} 0 1
[junit4:junit4] 2> 583418 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1435751721560178688)]} 0 1
[junit4:junit4] 2> 583419 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1435751721560178688)]} 0 5
[junit4:junit4] 2> 583419 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55]} 0 9
[junit4:junit4] 2> 583424 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1435751721569615872)]} 0 1
[junit4:junit4] 2> 583435 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1435751721578004480)]} 0 1
[junit4:junit4] 2> 583436 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1435751721578004480)]} 0 5
[junit4:junit4] 2> 583437 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 9
[junit4:junit4] 2> 583441 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435751721587441664)]} 0 1
[junit4:junit4] 2> 583451 T1229 C306 P58505 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1435751721593733120)]} 0 1
[junit4:junit4] 2> 583452 T1202 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1435751721593733120)]} 0 5
[junit4:junit4] 2> 583453 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57]} 0 9
[junit4:junit4] 2> 583456 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435751721602121728)]} 0 1
[junit4:junit4] 2> 583463 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1435751721606316032)]} 0 1
[junit4:junit4] 2> 583464 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435751721606316032)]} 0 5
[junit4:junit4] 2> 583468 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435751721614704640)]} 0 1
[junit4:junit4] 2> 583475 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1435751721618898944)]} 0 1
[junit4:junit4] 2> 583476 T1186 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435751721618898944)]} 0 5
[junit4:junit4] 2> 583479 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1435751721626238976)]} 0 1
[junit4:junit4] 2> 583489 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1435751721633579008)]} 0 1
[junit4:junit4] 2> 583490 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1435751721633579008)]} 0 5
[junit4:junit4] 2> 583491 T1200 C302 P36618 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60]} 0 9
[junit4:junit4] 2> 583496 T1160 C304 P12371 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435751721644064768)]} 0 1
[junit4:junit4] 2> 583507 T1214 C305 P25347 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:23084/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1435751721652453376)]} 0 1
[junit4:junit4] 2> 583508 T1184 C303 P23084 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36618/c
[...truncated too long message...]
solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369239414966/collection1_shard1_1_replica1/data [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369239414966/collection1_shard1_1_replica1/data;done=false>>]
[junit4:junit4] 2> 661006 T765 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369239414966/collection1_shard1_1_replica1/data
[junit4:junit4] 2> 661007 T918 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89734473430728714-127.0.0.1:44430_-n_0000000003) am no longer a leader.
[junit4:junit4] 2> 661008 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 661008 T856 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 661009 T839 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 661009 T839 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 661009 T765 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 661011 T856 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 661013 T856 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 661015 T856 oasc.Overseer.start Overseer (id=89734473430728716-127.0.0.1:44434_-n_0000000004) starting
[junit4:junit4] 2> 661021 T921 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 661022 T920 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 661064 T765 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 44434
[junit4:junit4] 2> 661064 T765 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1387377176
[junit4:junit4] 2> 662067 T765 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 662067 T765 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 662070 T765 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@3d7e80a8
[junit4:junit4] 2> 662072 T765 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=789,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 662073 T765 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 662073 T765 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 662074 T765 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 662076 T765 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 662077 T765 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 662077 T765 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369239401707/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369239401707/jetty4;done=false>>]
[junit4:junit4] 2> 662078 T765 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369239401707/jetty4
[junit4:junit4] 2> 662078 T765 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369239401707/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369239401707/jetty4/index;done=false>>]
[junit4:junit4] 2> 662079 T765 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369239401707/jetty4/index
[junit4:junit4] 2> 662080 T920 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89734473430728716-127.0.0.1:44434_-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 662081 T856 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 662081 T856 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 662081 T765 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 662082 T856 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 662154 T765 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 662156 T765 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:44407 44407
[junit4:junit4] 2> 662229 T765 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 44410
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369239401707 FAILED !!!!!
[junit4:junit4] 2> 662230 T765 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 662231 T765 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:44407 44407
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=1C035AE934BA8D5C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_CO -Dtests.timezone=Etc/GMT+4 -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 219s J0 | ChaosMonkeyShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:44418 returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([1C035AE934BA8D5C:9DE5D4F143E5ED60]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 662377 T765 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 218893 T764 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=es_CO, timezone=Etc/GMT+4
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=1,free=208141920,total=322961408
[junit4:junit4] 2> NOTE: All tests run in this JVM: [BasicFunctionalityTest, SortByFunctionTest, DirectUpdateHandlerTest, RequestHandlersTest, TestPhraseSuggestions, DirectSolrSpellCheckerTest, SystemInfoHandlerTest, TestFieldResource, TestMultiCoreConfBootstrap, TestSolrXMLSerializer, TestValueSourceCache, TestFastLRUCache, SolrRequestParserTest, TestSweetSpotSimilarityFactory, TestRandomFaceting, LeaderElectionIntegrationTest, TestSearchPerf, StatelessScriptUpdateProcessorFactoryTest, ReturnFieldsTest, TestSolrQueryParserDefaultOperatorResource, DistanceFunctionTest, TestAddFieldRealTimeGet, LukeRequestHandlerTest, BadComponentTest, MBeansHandlerTest, TestUpdate, TestPostingsSolrHighlighter, QueryParsingTest, SpellPossibilityIteratorTest, FieldAnalysisRequestHandlerTest, BasicDistributedZk2Test, BadCopyFieldTest, TestArbitraryIndexDir, DocValuesTest, TestDynamicFieldResource, TestXIncludeConfig, TestIndexSearcher, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 219.44s, 1 test, 1 error <<< FAILURES!
[...truncated 620 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:386: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:366: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 2 errors, 13 ignored (7 assumptions)
Total time: 51 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1273 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1273/
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:65345 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:65345 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([BCD13460AF17C0C7:3D37BA78D848A0FB]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9475 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 444064 T1135 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 444072 T1135 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1369212546972
[junit4:junit4] 2> 444074 T1135 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 444074 T1136 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 444176 T1135 oasc.ZkTestServer.run start zk server on port:65329
[junit4:junit4] 2> 444177 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 444181 T1142 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7de207b7 name:ZooKeeperConnection Watcher:127.0.0.1:65329 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 444182 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 444182 T1135 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 444187 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 444196 T1144 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7edacc28 name:ZooKeeperConnection Watcher:127.0.0.1:65329/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 444197 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 444197 T1135 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 444202 T1135 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 444212 T1135 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 444215 T1135 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 444218 T1135 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 444219 T1135 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 444232 T1135 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 444233 T1135 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 444339 T1135 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 444339 T1135 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 444349 T1135 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 444350 T1135 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 444353 T1135 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 444354 T1135 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 444358 T1135 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 444359 T1135 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 444362 T1135 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 444363 T1135 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 444367 T1135 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 444368 T1135 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 444371 T1135 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 444372 T1135 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 444638 T1135 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 444643 T1135 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:65339
[junit4:junit4] 2> 444644 T1135 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 444644 T1135 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 444645 T1135 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369212547276
[junit4:junit4] 2> 444646 T1135 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369212547276/solr.xml
[junit4:junit4] 2> 444646 T1135 oasc.CoreContainer.<init> New CoreContainer 125060590
[junit4:junit4] 2> 444647 T1135 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369212547276/'
[junit4:junit4] 2> 444647 T1135 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369212547276/'
[junit4:junit4] 2> 444776 T1135 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 444777 T1135 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 444778 T1135 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 444778 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 444779 T1135 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 444779 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 444780 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 444780 T1135 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 444781 T1135 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 444781 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 444798 T1135 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 444799 T1135 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65329/solr
[junit4:junit4] 2> 444799 T1135 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 444801 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 444805 T1155 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e7d1e8e name:ZooKeeperConnection Watcher:127.0.0.1:65329 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 444806 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 444808 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 444819 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 444822 T1157 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53dfef2b name:ZooKeeperConnection Watcher:127.0.0.1:65329/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 444822 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 444825 T1135 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 444836 T1135 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 444840 T1135 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 444843 T1135 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65339_
[junit4:junit4] 2> 444850 T1135 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65339_
[junit4:junit4] 2> 444855 T1135 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 444870 T1135 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 444874 T1135 oasc.Overseer.start Overseer (id=89732713478815747-127.0.0.1:65339_-n_0000000000) starting
[junit4:junit4] 2> 444879 T1135 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 444893 T1159 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 444894 T1135 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 444897 T1135 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 444907 T1135 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 444911 T1158 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 444915 T1160 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369212547276/collection1
[junit4:junit4] 2> 444915 T1160 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 444916 T1160 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 444917 T1160 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 444918 T1160 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369212547276/collection1/'
[junit4:junit4] 2> 444920 T1160 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369212547276/collection1/lib/README' to classloader
[junit4:junit4] 2> 444921 T1160 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369212547276/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 444974 T1160 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 445034 T1160 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 445136 T1160 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 445143 T1160 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 445743 T1160 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 445748 T1160 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 445750 T1160 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 445756 T1160 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 445786 T1160 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 445787 T1160 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369212547276/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/control/data/
[junit4:junit4] 2> 445787 T1160 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24245514
[junit4:junit4] 2> 445788 T1160 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 445788 T1160 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/control/data
[junit4:junit4] 2> 445789 T1160 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/control/data/index/
[junit4:junit4] 2> 445789 T1160 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 445790 T1160 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/control/data/index
[junit4:junit4] 2> 445794 T1160 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3abf4c88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@352f0582)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 445795 T1160 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 445798 T1160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 445798 T1160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 445799 T1160 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 445799 T1160 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 445800 T1160 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 445800 T1160 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 445801 T1160 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 445801 T1160 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 445802 T1160 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 445818 T1160 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 445826 T1160 oass.SolrIndexSearcher.<init> Opening Searcher@6485c386 main
[junit4:junit4] 2> 445826 T1160 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/control/data/tlog
[junit4:junit4] 2> 445827 T1160 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 445828 T1160 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 445832 T1161 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6485c386 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 445834 T1160 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 445834 T1160 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 446417 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 446418 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65339_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65339"}
[junit4:junit4] 2> 446418 T1158 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 446418 T1158 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 446440 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 446838 T1160 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 446838 T1160 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65339 collection:control_collection shard:shard1
[junit4:junit4] 2> 446839 T1160 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 446885 T1160 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 446896 T1160 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 446897 T1160 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 446897 T1160 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65339/collection1/
[junit4:junit4] 2> 446897 T1160 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 446898 T1160 oasc.SyncStrategy.syncToMe http://127.0.0.1:65339/collection1/ has no replicas
[junit4:junit4] 2> 446898 T1160 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65339/collection1/
[junit4:junit4] 2> 446898 T1160 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 447947 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 447980 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 447990 T1160 oasc.ZkController.register We are http://127.0.0.1:65339/collection1/ and leader is http://127.0.0.1:65339/collection1/
[junit4:junit4] 2> 447990 T1160 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65339
[junit4:junit4] 2> 447990 T1160 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 447990 T1160 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 447990 T1160 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 447993 T1160 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 447994 T1135 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 447995 T1135 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 447996 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 448012 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 448014 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 448016 T1164 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@381c36f4 name:ZooKeeperConnection Watcher:127.0.0.1:65329/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 448017 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 448019 T1135 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 448022 T1135 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 448285 T1135 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 448288 T1135 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:65345
[junit4:junit4] 2> 448290 T1135 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 448290 T1135 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 448291 T1135 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369212550922
[junit4:junit4] 2> 448291 T1135 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369212550922/solr.xml
[junit4:junit4] 2> 448292 T1135 oasc.CoreContainer.<init> New CoreContainer 1579954955
[junit4:junit4] 2> 448292 T1135 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369212550922/'
[junit4:junit4] 2> 448293 T1135 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369212550922/'
[junit4:junit4] 2> 448423 T1135 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 448424 T1135 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 448425 T1135 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 448425 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 448426 T1135 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 448426 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 448427 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 448427 T1135 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 448428 T1135 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 448428 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 448446 T1135 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 448447 T1135 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65329/solr
[junit4:junit4] 2> 448447 T1135 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 448448 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 448452 T1175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@143b1e3d name:ZooKeeperConnection Watcher:127.0.0.1:65329 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 448452 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 448464 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 448477 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 448479 T1177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@257dee6e name:ZooKeeperConnection Watcher:127.0.0.1:65329/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 448480 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 448486 T1135 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 449489 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 449490 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65339_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65339"}
[junit4:junit4] 2> 449492 T1135 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65345_
[junit4:junit4] 2> 449495 T1135 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65345_
[junit4:junit4] 2> 449509 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 449509 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 449509 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 449518 T1164 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 449518 T1177 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 449520 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 449522 T1157 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 449526 T1178 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369212550922/collection1
[junit4:junit4] 2> 449527 T1178 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 449527 T1178 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 449528 T1178 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 449530 T1178 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369212550922/collection1/'
[junit4:junit4] 2> 449531 T1178 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369212550922/collection1/lib/README' to classloader
[junit4:junit4] 2> 449532 T1178 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369212550922/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 449590 T1178 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 449657 T1178 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 449759 T1178 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 449766 T1178 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 450379 T1178 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 450382 T1178 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 450384 T1178 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 450389 T1178 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 450408 T1178 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 450409 T1178 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369212550922/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty1/
[junit4:junit4] 2> 450409 T1178 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24245514
[junit4:junit4] 2> 450410 T1178 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 450410 T1178 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty1
[junit4:junit4] 2> 450410 T1178 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty1/index/
[junit4:junit4] 2> 450410 T1178 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 450411 T1178 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty1/index
[junit4:junit4] 2> 450414 T1178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@23d04d74 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48973596)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 450414 T1178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 450417 T1178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 450417 T1178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 450417 T1178 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 450418 T1178 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 450418 T1178 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 450419 T1178 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 450419 T1178 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 450419 T1178 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 450420 T1178 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 450433 T1178 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 450439 T1178 oass.SolrIndexSearcher.<init> Opening Searcher@2445daca main
[junit4:junit4] 2> 450439 T1178 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty1/tlog
[junit4:junit4] 2> 450440 T1178 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 450441 T1178 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 450444 T1179 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2445daca main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 450445 T1178 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 450446 T1178 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 451021 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 451021 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65345_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65345"}
[junit4:junit4] 2> 451022 T1158 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 451022 T1158 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 451071 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 451071 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 451071 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 451448 T1178 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 451448 T1178 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65345 collection:collection1 shard:shard1
[junit4:junit4] 2> 451449 T1178 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 451476 T1178 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 451481 T1178 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 451481 T1178 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 451482 T1178 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65345/collection1/
[junit4:junit4] 2> 451482 T1178 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 451482 T1178 oasc.SyncStrategy.syncToMe http://127.0.0.1:65345/collection1/ has no replicas
[junit4:junit4] 2> 451482 T1178 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65345/collection1/
[junit4:junit4] 2> 451482 T1178 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 452614 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 452641 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 452641 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 452641 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 452682 T1178 oasc.ZkController.register We are http://127.0.0.1:65345/collection1/ and leader is http://127.0.0.1:65345/collection1/
[junit4:junit4] 2> 452682 T1178 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65345
[junit4:junit4] 2> 452682 T1178 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 452682 T1178 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 452683 T1178 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 452685 T1178 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 452686 T1135 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 452687 T1135 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 452688 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 452971 T1135 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 452975 T1135 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:65352
[junit4:junit4] 2> 452976 T1135 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 452977 T1135 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 452977 T1135 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369212555602
[junit4:junit4] 2> 452978 T1135 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369212555602/solr.xml
[junit4:junit4] 2> 452978 T1135 oasc.CoreContainer.<init> New CoreContainer 1796725563
[junit4:junit4] 2> 452979 T1135 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369212555602/'
[junit4:junit4] 2> 452979 T1135 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369212555602/'
[junit4:junit4] 2> 453119 T1135 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 453120 T1135 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 453120 T1135 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 453121 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 453121 T1135 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 453122 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 453122 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 453123 T1135 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 453124 T1135 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 453124 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 453140 T1135 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 453140 T1135 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65329/solr
[junit4:junit4] 2> 453141 T1135 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 453142 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 453145 T1191 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69ad07c1 name:ZooKeeperConnection Watcher:127.0.0.1:65329 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 453146 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 453149 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 453160 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 453162 T1193 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d763b27 name:ZooKeeperConnection Watcher:127.0.0.1:65329/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 453162 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 453175 T1135 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 454156 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 454157 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65345_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65345"}
[junit4:junit4] 2> 454175 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 454175 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 454175 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 454175 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 454180 T1135 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65352_
[junit4:junit4] 2> 454182 T1135 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65352_
[junit4:junit4] 2> 454190 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 454190 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 454191 T1177 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 454191 T1193 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 454191 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 454191 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 454192 T1164 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 454193 T1157 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 454200 T1194 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369212555602/collection1
[junit4:junit4] 2> 454200 T1194 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 454201 T1194 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 454201 T1194 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 454203 T1194 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369212555602/collection1/'
[junit4:junit4] 2> 454205 T1194 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369212555602/collection1/lib/README' to classloader
[junit4:junit4] 2> 454205 T1194 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369212555602/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 454258 T1194 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 454319 T1194 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 454421 T1194 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 454428 T1194 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 455015 T1194 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 455019 T1194 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 455021 T1194 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 455027 T1194 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 455056 T1194 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 455057 T1194 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369212555602/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty2/
[junit4:junit4] 2> 455057 T1194 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24245514
[junit4:junit4] 2> 455058 T1194 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 455059 T1194 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty2
[junit4:junit4] 2> 455059 T1194 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty2/index/
[junit4:junit4] 2> 455059 T1194 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 455060 T1194 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty2/index
[junit4:junit4] 2> 455064 T1194 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@53c37804 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7a37f9)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 455064 T1194 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 455067 T1194 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 455068 T1194 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 455068 T1194 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 455069 T1194 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 455070 T1194 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 455070 T1194 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 455071 T1194 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 455071 T1194 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 455072 T1194 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 455088 T1194 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 455096 T1194 oass.SolrIndexSearcher.<init> Opening Searcher@d91c129 main
[junit4:junit4] 2> 455096 T1194 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty2/tlog
[junit4:junit4] 2> 455097 T1194 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 455098 T1194 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 455103 T1195 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d91c129 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 455106 T1194 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 455106 T1194 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 455682 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 455683 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65352_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65352"}
[junit4:junit4] 2> 455684 T1158 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 455684 T1158 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 455697 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 455697 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 455697 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 455697 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 456110 T1194 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 456110 T1194 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65352 collection:collection1 shard:shard2
[junit4:junit4] 2> 456111 T1194 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 456209 T1194 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 456237 T1194 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 456238 T1194 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 456238 T1194 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65352/collection1/
[junit4:junit4] 2> 456238 T1194 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 456238 T1194 oasc.SyncStrategy.syncToMe http://127.0.0.1:65352/collection1/ has no replicas
[junit4:junit4] 2> 456239 T1194 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65352/collection1/
[junit4:junit4] 2> 456239 T1194 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 457205 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 457253 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 457253 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 457253 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 457253 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 457256 T1194 oasc.ZkController.register We are http://127.0.0.1:65352/collection1/ and leader is http://127.0.0.1:65352/collection1/
[junit4:junit4] 2> 457256 T1194 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65352
[junit4:junit4] 2> 457256 T1194 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 457256 T1194 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 457257 T1194 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 457266 T1194 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 457268 T1135 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 457268 T1135 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 457269 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 457548 T1135 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 457551 T1135 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:65368
[junit4:junit4] 2> 457552 T1135 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 457553 T1135 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 457553 T1135 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369212560184
[junit4:junit4] 2> 457554 T1135 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369212560184/solr.xml
[junit4:junit4] 2> 457554 T1135 oasc.CoreContainer.<init> New CoreContainer 1440521746
[junit4:junit4] 2> 457555 T1135 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369212560184/'
[junit4:junit4] 2> 457556 T1135 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369212560184/'
[junit4:junit4] 2> 457686 T1135 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 457687 T1135 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 457687 T1135 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 457688 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 457688 T1135 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 457689 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 457689 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 457690 T1135 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 457690 T1135 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 457691 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 457707 T1135 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 457708 T1135 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65329/solr
[junit4:junit4] 2> 457709 T1135 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 457710 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 457713 T1207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76b66ded name:ZooKeeperConnection Watcher:127.0.0.1:65329 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 457714 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 457718 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 457729 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 457732 T1209 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@752d7383 name:ZooKeeperConnection Watcher:127.0.0.1:65329/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 457733 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 457746 T1135 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 458751 T1135 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65368_
[junit4:junit4] 2> 458754 T1135 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65368_
[junit4:junit4] 2> 458757 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 458758 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 458759 T1209 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 458759 T1177 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 458759 T1193 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 458759 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 458759 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 458760 T1164 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 458760 T1157 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 458770 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 458771 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65352_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65352"}
[junit4:junit4] 2> 458774 T1210 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369212560184/collection1
[junit4:junit4] 2> 458774 T1210 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 458775 T1210 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 458776 T1210 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 458785 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 458785 T1209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 458785 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 458785 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 458785 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 458786 T1210 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369212560184/collection1/'
[junit4:junit4] 2> 458788 T1210 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369212560184/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 458789 T1210 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369212560184/collection1/lib/README' to classloader
[junit4:junit4] 2> 458836 T1210 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 458880 T1210 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 458982 T1210 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 458987 T1210 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 459442 T1210 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 459445 T1210 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 459447 T1210 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 459451 T1210 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 459472 T1210 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 459472 T1210 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369212560184/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3/
[junit4:junit4] 2> 459473 T1210 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24245514
[junit4:junit4] 2> 459473 T1210 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 459474 T1210 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3
[junit4:junit4] 2> 459474 T1210 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3/index/
[junit4:junit4] 2> 459474 T1210 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 459474 T1210 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3/index
[junit4:junit4] 2> 459478 T1210 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2421f3f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d420393)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 459478 T1210 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 459481 T1210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 459481 T1210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 459481 T1210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 459482 T1210 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 459482 T1210 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 459483 T1210 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 459483 T1210 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 459483 T1210 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 459484 T1210 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 459496 T1210 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 459502 T1210 oass.SolrIndexSearcher.<init> Opening Searcher@4ef42282 main
[junit4:junit4] 2> 459502 T1210 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3/tlog
[junit4:junit4] 2> 459503 T1210 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 459503 T1210 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 459507 T1211 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4ef42282 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 459508 T1210 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 459509 T1210 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 460291 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 460292 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65368_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65368"}
[junit4:junit4] 2> 460292 T1158 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 460293 T1158 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 460307 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 460307 T1209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 460307 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 460307 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 460307 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 460513 T1210 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 460513 T1210 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65368 collection:collection1 shard:shard1
[junit4:junit4] 2> 460517 T1210 oasc.ZkController.register We are http://127.0.0.1:65368/collection1/ and leader is http://127.0.0.1:65345/collection1/
[junit4:junit4] 2> 460517 T1210 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65368
[junit4:junit4] 2> 460518 T1210 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 460518 T1210 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1531 name=collection1 org.apache.solr.core.SolrCore@502a46de url=http://127.0.0.1:65368/collection1 node=127.0.0.1:65368_ C1531_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:65368_, base_url=http://127.0.0.1:65368}
[junit4:junit4] 2> 460518 T1212 C1531 P65368 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 460518 T1210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 460519 T1212 C1531 P65368 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 460520 T1212 C1531 P65368 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 460520 T1212 C1531 P65368 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 460521 T1135 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 460521 T1135 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 460522 T1212 C1531 P65368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 460522 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 460543 T1167 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 460811 T1135 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 460814 T1135 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:65375
[junit4:junit4] 2> 460815 T1135 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 460815 T1135 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 460816 T1135 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369212563440
[junit4:junit4] 2> 460816 T1135 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369212563440/solr.xml
[junit4:junit4] 2> 460817 T1135 oasc.CoreContainer.<init> New CoreContainer 1452805835
[junit4:junit4] 2> 460817 T1135 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369212563440/'
[junit4:junit4] 2> 460818 T1135 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369212563440/'
[junit4:junit4] 2> 460969 T1135 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 460970 T1135 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 460970 T1135 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 460970 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 460971 T1135 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 460971 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 460972 T1135 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 460972 T1135 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 460972 T1135 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 460973 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 460989 T1135 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 460990 T1135 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65329/solr
[junit4:junit4] 2> 460990 T1135 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 460991 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 460994 T1224 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@519a7b47 name:ZooKeeperConnection Watcher:127.0.0.1:65329 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 460995 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 461038 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 461047 T1135 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 461058 T1226 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3418d581 name:ZooKeeperConnection Watcher:127.0.0.1:65329/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 461058 T1135 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 461079 T1135 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 461814 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 461815 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65368_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65368"}
[junit4:junit4] 2> 461834 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 461834 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 461834 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 461834 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 461834 T1209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 461834 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 462084 T1135 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65375_
[junit4:junit4] 2> 462088 T1135 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65375_
[junit4:junit4] 2> 462091 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 462091 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 462091 T1226 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 462092 T1177 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 462092 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 462092 T1193 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 462091 T1209 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 462092 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 462092 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 462093 T1157 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 462093 T1164 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 462093 T1209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 462108 T1227 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369212563440/collection1
[junit4:junit4] 2> 462108 T1227 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 462109 T1227 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 462109 T1227 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 462111 T1227 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369212563440/collection1/'
[junit4:junit4] 2> 462113 T1227 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369212563440/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 462114 T1227 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369212563440/collection1/lib/README' to classloader
[junit4:junit4] 2> 462172 T1227 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 462239 T1227 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 462342 T1227 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 462349 T1227 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 462545 T1167 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 462545 T1167 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:65368_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 462943 T1227 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 462947 T1227 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 462950 T1227 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 462955 T1227 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 462982 T1227 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 462983 T1227 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369212563440/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/
[junit4:junit4] 2> 462983 T1227 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24245514
[junit4:junit4] 2> 462984 T1227 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 462984 T1227 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4
[junit4:junit4] 2> 462985 T1227 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index/
[junit4:junit4] 2> 462985 T1227 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 462985 T1227 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index
[junit4:junit4] 2> 462989 T1227 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6cf96e lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cd34ad9)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 462989 T1227 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 462993 T1227 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 462993 T1227 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 462994 T1227 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 462994 T1227 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 462995 T1227 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 462995 T1227 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 462996 T1227 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 462996 T1227 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 462997 T1227 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 463012 T1227 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 463019 T1227 oass.SolrIndexSearcher.<init> Opening Searcher@297c074e main
[junit4:junit4] 2> 463019 T1227 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/tlog
[junit4:junit4] 2> 463020 T1227 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 463021 T1227 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 463026 T1228 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@297c074e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 463028 T1227 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 463028 T1227 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 463341 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 463342 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65375_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65375"}
[junit4:junit4] 2> 463342 T1158 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 463342 T1158 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 463355 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 463355 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 463355 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 463355 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 463355 T1209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 463355 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 464031 T1227 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 464031 T1227 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65375 collection:collection1 shard:shard2
[junit4:junit4] 2> 464035 T1227 oasc.ZkController.register We are http://127.0.0.1:65375/collection1/ and leader is http://127.0.0.1:65352/collection1/
[junit4:junit4] 2> 464035 T1227 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65375
[junit4:junit4] 2> 464036 T1227 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 464036 T1227 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1532 name=collection1 org.apache.solr.core.SolrCore@208189a6 url=http://127.0.0.1:65375/collection1 node=127.0.0.1:65375_ C1532_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:65375_, base_url=http://127.0.0.1:65375}
[junit4:junit4] 2> 464036 T1229 C1532 P65375 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 464038 T1229 C1532 P65375 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 464038 T1227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 464038 T1229 C1532 P65375 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 464038 T1229 C1532 P65375 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 464039 T1135 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 464040 T1229 C1532 P65375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 464040 T1135 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 464041 T1135 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 464063 T1135 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 464064 T1183 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 464065 T1135 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 464066 T1135 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 464067 T1135 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C1533 name=collection1 org.apache.solr.core.SolrCore@502a46de url=http://127.0.0.1:65368/collection1 node=127.0.0.1:65368_ C1533_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:65368_, base_url=http://127.0.0.1:65368}
[junit4:junit4] 2> 464548 T1212 C1533 P65368 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:65345/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 464548 T1212 C1533 P65368 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:65368 START replicas=[http://127.0.0.1:65345/collection1/] nUpdates=100
[junit4:junit4] 2> 464549 T1212 C1533 P65368 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 464549 T1212 C1533 P65368 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 464549 T1212 C1533 P65368 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 464549 T1212 C1533 P65368 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 464550 T1212 C1533 P65368 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 464551 T1212 C1533 P65368 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:65345/collection1/. core=collection1
[junit4:junit4] 2> 464551 T1212 C1533 P65368 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1534 name=collection1 org.apache.solr.core.SolrCore@39624380 url=http://127.0.0.1:65345/collection1 node=127.0.0.1:65345_ C1534_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65345_, base_url=http://127.0.0.1:65345, leader=true}
[junit4:junit4] 2> 464558 T1168 C1534 P65345 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 464562 T1169 C1534 P65345 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 464565 T1169 C1534 P65345 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@23d04d74 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48973596)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 464565 T1169 C1534 P65345 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 464566 T1169 C1534 P65345 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@23d04d74 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48973596)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@23d04d74 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48973596)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 464566 T1169 C1534 P65345 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 464567 T1169 C1534 P65345 oass.SolrIndexSearcher.<init> Opening Searcher@3d170acd realtime
[junit4:junit4] 2> 464567 T1169 C1534 P65345 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 464568 T1169 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 464569 T1212 C1533 P65368 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 464569 T1212 C1533 P65368 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 464572 T1170 C1534 P65345 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 464573 T1170 C1534 P65345 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4] 2> 464573 T1212 C1533 P65368 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 464574 T1212 C1533 P65368 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 464574 T1212 C1533 P65368 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 464577 T1170 C1534 P65345 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 464578 T1212 C1533 P65368 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 464579 T1212 C1533 P65368 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3/index.20130522054927477
[junit4:junit4] 2> 464579 T1212 C1533 P65368 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@692d94b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2241bf9a) fullCopy=false
[junit4:junit4] 2> 464582 T1170 C1534 P65345 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 464583 T1212 C1533 P65368 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 464584 T1212 C1533 P65368 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 464584 T1212 C1533 P65368 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 464586 T1212 C1533 P65368 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2421f3f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d420393)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2421f3f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d420393)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 464587 T1212 C1533 P65368 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 464587 T1212 C1533 P65368 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 464588 T1212 C1533 P65368 oass.SolrIndexSearcher.<init> Opening Searcher@4fbfdd5 main
[junit4:junit4] 2> 464589 T1211 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4fbfdd5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 464589 T1212 C1533 P65368 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3/index.20130522054927477 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3/index.20130522054927477;done=true>>]
[junit4:junit4] 2> 464590 T1212 C1533 P65368 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3/index.20130522054927477
[junit4:junit4] 2> 464590 T1212 C1533 P65368 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty3/index.20130522054927477
[junit4:junit4] 2> 464590 T1212 C1533 P65368 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 464590 T1212 C1533 P65368 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 464591 T1212 C1533 P65368 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 464591 T1212 C1533 P65368 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 464594 T1212 C1533 P65368 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 464861 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 464862 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65375_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65375"}
[junit4:junit4] 2> 464879 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65368_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65368"}
[junit4:junit4] 2> 464890 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 464890 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 464890 T1209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 464890 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 464890 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 464890 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 465068 T1183 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 465068 T1183 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:65375_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1004
[junit4:junit4] 2> 465070 T1135 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 466074 T1135 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C1532_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:65375_, base_url=http://127.0.0.1:65375}
[junit4:junit4] 2> 467071 T1229 C1532 P65375 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:65352/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 467071 T1229 C1532 P65375 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:65375 START replicas=[http://127.0.0.1:65352/collection1/] nUpdates=100
[junit4:junit4] 2> 467072 T1229 C1532 P65375 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 467072 T1229 C1532 P65375 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 467072 T1229 C1532 P65375 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 467072 T1229 C1532 P65375 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 467073 T1229 C1532 P65375 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 467073 T1229 C1532 P65375 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:65352/collection1/. core=collection1
[junit4:junit4] 2> 467074 T1229 C1532 P65375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 467077 T1135 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C1535 name=collection1 org.apache.solr.core.SolrCore@4f717c4f url=http://127.0.0.1:65352/collection1 node=127.0.0.1:65352_ C1535_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65352_, base_url=http://127.0.0.1:65352, leader=true}
[junit4:junit4] 2> 467082 T1184 C1535 P65352 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 467086 T1185 C1535 P65352 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 467088 T1185 C1535 P65352 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@53c37804 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7a37f9)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 467089 T1185 C1535 P65352 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 467090 T1185 C1535 P65352 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@53c37804 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7a37f9)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@53c37804 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7a37f9)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 467090 T1185 C1535 P65352 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 467091 T1185 C1535 P65352 oass.SolrIndexSearcher.<init> Opening Searcher@728c5129 realtime
[junit4:junit4] 2> 467091 T1185 C1535 P65352 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 467092 T1185 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 467093 T1229 C1532 P65375 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 467093 T1229 C1532 P65375 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 467095 T1186 C1535 P65352 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 467095 T1186 C1535 P65352 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 467096 T1229 C1532 P65375 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 467096 T1229 C1532 P65375 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 467096 T1229 C1532 P65375 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 467098 T1186 C1535 P65352 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 467099 T1229 C1532 P65375 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 467100 T1229 C1532 P65375 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index.20130522054929998
[junit4:junit4] 2> 467100 T1229 C1532 P65375 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@c99c5b6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1dce486b) fullCopy=false
[junit4:junit4] 2> 467103 T1186 C1535 P65352 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 467104 T1229 C1532 P65375 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 467105 T1229 C1532 P65375 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 467105 T1229 C1532 P65375 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 467107 T1229 C1532 P65375 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6cf96e lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cd34ad9)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6cf96e lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cd34ad9)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 467107 T1229 C1532 P65375 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 467108 T1229 C1532 P65375 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 467108 T1229 C1532 P65375 oass.SolrIndexSearcher.<init> Opening Searcher@212a8b33 main
[junit4:junit4] 2> 467109 T1228 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@212a8b33 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 467110 T1229 C1532 P65375 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index.20130522054929998 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index.20130522054929998;done=true>>]
[junit4:junit4] 2> 467110 T1229 C1532 P65375 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index.20130522054929998
[junit4:junit4] 2> 467111 T1229 C1532 P65375 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index.20130522054929998
[junit4:junit4] 2> 467111 T1229 C1532 P65375 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 467111 T1229 C1532 P65375 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 467111 T1229 C1532 P65375 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 467112 T1229 C1532 P65375 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 467116 T1229 C1532 P65375 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 467906 T1158 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 467907 T1158 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65375_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65375"}
[junit4:junit4] 2> 467920 T1164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 467920 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 467920 T1193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 467920 T1209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 467920 T1177 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 467920 T1157 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 468080 T1135 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 468081 T1135 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C1536 name=collection1 org.apache.solr.core.SolrCore@51330e76 url=http://127.0.0.1:65339/collection1 node=127.0.0.1:65339_ C1536_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:65339_, base_url=http://127.0.0.1:65339, leader=true}
[junit4:junit4] 2> 468090 T1147 C1536 P65339 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 468093 T1147 C1536 P65339 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3abf4c88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@352f0582)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 468094 T1147 C1536 P65339 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 468095 T1147 C1536 P65339 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3abf4c88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@352f0582)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3abf4c88 lockFactory=org.apache.lucene.store.NativeFSLockFactory@352f0582)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 468095 T1147 C1536 P65339 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 468096 T1147 C1536 P65339 oass.SolrIndexSearcher.<init> Opening Searcher@243dd5d4 main
[junit4:junit4] 2> 468096 T1147 C1536 P65339 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 468097 T1161 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@243dd5d4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 468098 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 468111 T1171 C1534 P65345 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 468112 T1171 C1534 P65345 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@23d04d74 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48973596)),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@23d04d74 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48973596)),segFN=segments_3,generation=3}
[junit4:junit4] 2> 468112 T1171 C1534 P65345 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 468113 T1171 C1534 P65345 oass.SolrIndexSearcher.<init> Opening Searcher@6c240ee1 main
[junit4:junit4] 2> 468113 T1171 C1534 P65345 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 468114 T1179 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c240ee1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 468115 T1171 C1534 P65345 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:65368/collection1/, StdNode: http://127.0.0.1:65352/collection1/, StdNode: http://127.0.0.1:65375/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 468118 T1187 C1535 P65352 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 468119 T1187 C1535 P65352 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@53c37804 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7a37f9)),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@53c37804 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7a37f9)),segFN=segments_3,generation=3}
[junit4:junit4] 2> 468119 T1187 C1535 P65352 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 468120 T1187 C1535 P65352 oass.SolrIndexSearcher.<init> Opening Searcher@79fd21d8 main
[junit4:junit4] 2> 468120 T1187 C1535 P65352 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 468121 T1195 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@79fd21d8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 468122 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> C1533_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65368_, base_url=http://127.0.0.1:65368}
[junit4:junit4] 2> 468125 T1199 C1533 P65368 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C1532_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:65375_, base_url=http://127.0.0.1:65375}
[junit4:junit4] 2> 468125 T1216 C1532 P65375 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 468126 T1199 C1533 P65368 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2421f3f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d420393)),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2421f3f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d420393)),segFN=segments_3,generation=3}
[junit4:junit4] 2> 468127 T1216 C1532 P65375 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6cf96e lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cd34ad9)),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1d6cf96e lockFactory=org.apache.lucene.store.NativeFSLockFactory@4cd34ad9)),segFN=segments_3,generation=3}
[junit4:junit4] 2> 468127 T1199 C1533 P65368 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 468127 T1216 C1532 P65375 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 468128 T1199 C1533 P65368 oass.SolrIndexSearcher.<init> Opening Searcher@154f87dc main
[junit4:junit4] 2> 468129 T1216 C1532 P65375 oass.SolrIndexSearcher.<init> Opening Searcher@28f7c8e4 main
[junit4:junit4] 2> 468129 T1199 C1533 P65368 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 468130 T1216 C1532 P65375 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 468130 T1211 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@154f87dc main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 468130 T1228 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@28f7c8e4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 468131 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 468131 T1216 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 468132 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4] 2> 468133 T1135 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 468136 T1172 C1534 P65345 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 468139 T1200 C1533 P65368 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 468141 T1188 C1535 P65352 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 468143 T1217 C1532 P65375 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 470149 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435723442994282496)} 0 2
[junit4:junit4] 2> 470157 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435723442998476800&update.from=http://127.0.0.1:65352/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435723442998476800)} 0 2
[junit4:junit4] 2> 470160 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435723443003719680&update.from=http://127.0.0.1:65345/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435723443003719680)} 0 1
[junit4:junit4] 2> 470161 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435723443003719680)} 0 6
[junit4:junit4] 2> 470162 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435723442998476800)} 0 11
[junit4:junit4] 2> 470165 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1435723443013156864)]} 0 0
[junit4:junit4] 2> 470179 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435723443024691200)]} 0 0
[junit4:junit4] 2> 470180 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1435723443024691200)]} 0 4
[junit4:junit4] 2> 470181 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0]} 0 13
[junit4:junit4] 2> 470183 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435723443032031232)]} 0 0
[junit4:junit4] 2> 470190 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435723443037274112)]} 0 0
[junit4:junit4] 2> 470191 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1435723443037274112)]} 0 3
[junit4:junit4] 2> 470191 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1]} 0 5
[junit4:junit4] 2> 470194 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1435723443043565568)]} 0 0
[junit4:junit4] 2> 470199 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435723443046711296)]} 0 0
[junit4:junit4] 2> 470200 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1435723443046711296)]} 0 3
[junit4:junit4] 2> 470203 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435723443053002752)]} 0 0
[junit4:junit4] 2> 470208 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435723443056148480)]} 0 0
[junit4:junit4] 2> 470209 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435723443056148480)]} 0 3
[junit4:junit4] 2> 470211 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435723443061391360)]} 0 0
[junit4:junit4] 2> 470218 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435723443066634240)]} 0 0
[junit4:junit4] 2> 470219 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1435723443066634240)]} 0 3
[junit4:junit4] 2> 470219 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4]} 0 5
[junit4:junit4] 2> 470222 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1435723443072925696)]} 0 0
[junit4:junit4] 2> 470227 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435723443076071424)]} 0 0
[junit4:junit4] 2> 470228 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1435723443076071424)]} 0 3
[junit4:junit4] 2> 470231 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1435723443082362880)]} 0 0
[junit4:junit4] 2> 470236 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435723443085508608)]} 0 0
[junit4:junit4] 2> 470237 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1435723443085508608)]} 0 3
[junit4:junit4] 2> 470239 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1435723443090751488)]} 0 0
[junit4:junit4] 2> 470246 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435723443095994368)]} 0 0
[junit4:junit4] 2> 470247 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1435723443095994368)]} 0 3
[junit4:junit4] 2> 470247 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7]} 0 5
[junit4:junit4] 2> 470250 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435723443102285824)]} 0 0
[junit4:junit4] 2> 470255 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435723443105431552)]} 0 0
[junit4:junit4] 2> 470256 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435723443105431552)]} 0 3
[junit4:junit4] 2> 470258 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1435723443110674432)]} 0 0
[junit4:junit4] 2> 470263 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435723443113820160)]} 0 0
[junit4:junit4] 2> 470264 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1435723443113820160)]} 0 3
[junit4:junit4] 2> 470266 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1435723443119063040)]} 0 0
[junit4:junit4] 2> 470271 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435723443122208768)]} 0 0
[junit4:junit4] 2> 470272 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1435723443122208768)]} 0 3
[junit4:junit4] 2> 470274 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1435723443127451648)]} 0 0
[junit4:junit4] 2> 470281 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435723443132694528)]} 0 0
[junit4:junit4] 2> 470282 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1435723443132694528)]} 0 3
[junit4:junit4] 2> 470283 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11]} 0 6
[junit4:junit4] 2> 470285 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1435723443138985984)]} 0 0
[junit4:junit4] 2> 470290 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435723443142131712)]} 0 0
[junit4:junit4] 2> 470291 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1435723443142131712)]} 0 3
[junit4:junit4] 2> 470294 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1435723443148423168)]} 0 0
[junit4:junit4] 2> 470301 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435723443153666048)]} 0 0
[junit4:junit4] 2> 470302 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[13 (1435723443153666048)]} 0 3
[junit4:junit4] 2> 470302 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13]} 0 5
[junit4:junit4] 2> 470305 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1435723443159957504)]} 0 0
[junit4:junit4] 2> 470310 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435723443163103232)]} 0 0
[junit4:junit4] 2> 470311 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1435723443163103232)]} 0 3
[junit4:junit4] 2> 470313 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435723443168346112)]} 0 0
[junit4:junit4] 2> 470318 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435723443171491840)]} 0 0
[junit4:junit4] 2> 470319 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435723443171491840)]} 0 3
[junit4:junit4] 2> 470321 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1435723443176734720)]} 0 0
[junit4:junit4] 2> 470328 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435723443181977600)]} 0 0
[junit4:junit4] 2> 470329 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[16 (1435723443181977600)]} 0 3
[junit4:junit4] 2> 470329 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16]} 0 5
[junit4:junit4] 2> 470332 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1435723443188269056)]} 0 0
[junit4:junit4] 2> 470337 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435723443191414784)]} 0 0
[junit4:junit4] 2> 470338 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1435723443191414784)]} 0 3
[junit4:junit4] 2> 470341 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1435723443197706240)]} 0 0
[junit4:junit4] 2> 470348 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435723443202949120)]} 0 0
[junit4:junit4] 2> 470349 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[18 (1435723443202949120)]} 0 3
[junit4:junit4] 2> 470349 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18]} 0 5
[junit4:junit4] 2> 470352 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1435723443209240576)]} 0 0
[junit4:junit4] 2> 470357 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435723443212386304)]} 0 0
[junit4:junit4] 2> 470358 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1435723443212386304)]} 0 3
[junit4:junit4] 2> 470360 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1435723443217629184)]} 0 0
[junit4:junit4] 2> 470367 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435723443222872064)]} 0 0
[junit4:junit4] 2> 470368 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[20 (1435723443222872064)]} 0 3
[junit4:junit4] 2> 470368 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20]} 0 5
[junit4:junit4] 2> 470371 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1435723443229163520)]} 0 0
[junit4:junit4] 2> 470376 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435723443232309248)]} 0 0
[junit4:junit4] 2> 470377 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1435723443232309248)]} 0 3
[junit4:junit4] 2> 470379 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1435723443237552128)]} 0 0
[junit4:junit4] 2> 470384 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435723443240697856)]} 0 0
[junit4:junit4] 2> 470385 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1435723443240697856)]} 0 3
[junit4:junit4] 2> 470388 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1435723443246989312)]} 0 0
[junit4:junit4] 2> 470393 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435723443250135040)]} 0 0
[junit4:junit4] 2> 470394 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1435723443250135040)]} 0 3
[junit4:junit4] 2> 470397 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24 (1435723443256426496)]} 0 0
[junit4:junit4] 2> 470402 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435723443259572224)]} 0 0
[junit4:junit4] 2> 470403 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24 (1435723443259572224)]} 0 3
[junit4:junit4] 2> 470405 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1435723443264815104)]} 0 0
[junit4:junit4] 2> 470412 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435723443270057984)]} 0 0
[junit4:junit4] 2> 470413 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1435723443270057984)]} 0 3
[junit4:junit4] 2> 470413 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25]} 0 5
[junit4:junit4] 2> 470416 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26 (1435723443276349440)]} 0 0
[junit4:junit4] 2> 470423 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435723443281592320)]} 0 0
[junit4:junit4] 2> 470424 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1435723443281592320)]} 0 3
[junit4:junit4] 2> 470424 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26]} 0 5
[junit4:junit4] 2> 470427 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27 (1435723443287883776)]} 0 0
[junit4:junit4] 2> 470434 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435723443293126656)]} 0 0
[junit4:junit4] 2> 470435 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[27 (1435723443293126656)]} 0 3
[junit4:junit4] 2> 470435 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27]} 0 5
[junit4:junit4] 2> 470438 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28 (1435723443299418112)]} 0 0
[junit4:junit4] 2> 470445 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435723443304660992)]} 0 0
[junit4:junit4] 2> 470446 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[28 (1435723443304660992)]} 0 3
[junit4:junit4] 2> 470447 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28]} 0 6
[junit4:junit4] 2> 470449 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1435723443310952448)]} 0 0
[junit4:junit4] 2> 470456 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435723443316195328)]} 0 0
[junit4:junit4] 2> 470457 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[29 (1435723443316195328)]} 0 3
[junit4:junit4] 2> 470457 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29]} 0 5
[junit4:junit4] 2> 470460 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1435723443322486784)]} 0 0
[junit4:junit4] 2> 470465 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435723443325632512)]} 0 0
[junit4:junit4] 2> 470466 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1435723443325632512)]} 0 3
[junit4:junit4] 2> 470468 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1435723443330875392)]} 0 0
[junit4:junit4] 2> 470475 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435723443336118272)]} 0 0
[junit4:junit4] 2> 470476 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[31 (1435723443336118272)]} 0 3
[junit4:junit4] 2> 470476 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31]} 0 5
[junit4:junit4] 2> 470479 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1435723443342409728)]} 0 0
[junit4:junit4] 2> 470486 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435723443347652608)]} 0 0
[junit4:junit4] 2> 470487 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[32 (1435723443347652608)]} 0 3
[junit4:junit4] 2> 470487 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32]} 0 5
[junit4:junit4] 2> 470490 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1435723443353944064)]} 0 0
[junit4:junit4] 2> 470497 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435723443359186944)]} 0 0
[junit4:junit4] 2> 470498 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[33 (1435723443359186944)]} 0 3
[junit4:junit4] 2> 470498 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33]} 0 5
[junit4:junit4] 2> 470501 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34 (1435723443365478400)]} 0 0
[junit4:junit4] 2> 470508 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1435723443370721280)]} 0 0
[junit4:junit4] 2> 470509 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[34 (1435723443370721280)]} 0 3
[junit4:junit4] 2> 470509 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34]} 0 5
[junit4:junit4] 2> 470512 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35 (1435723443377012736)]} 0 0
[junit4:junit4] 2> 470519 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1435723443382255616)]} 0 0
[junit4:junit4] 2> 470520 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[35 (1435723443382255616)]} 0 3
[junit4:junit4] 2> 470520 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35]} 0 5
[junit4:junit4] 2> 470523 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36 (1435723443388547072)]} 0 0
[junit4:junit4] 2> 470528 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1435723443391692800)]} 0 0
[junit4:junit4] 2> 470529 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36 (1435723443391692800)]} 0 3
[junit4:junit4] 2> 470532 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37 (1435723443397984256)]} 0 0
[junit4:junit4] 2> 470539 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1435723443403227136)]} 0 0
[junit4:junit4] 2> 470540 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[37 (1435723443403227136)]} 0 3
[junit4:junit4] 2> 470540 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37]} 0 5
[junit4:junit4] 2> 470543 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38 (1435723443409518592)]} 0 0
[junit4:junit4] 2> 470548 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1435723443412664320)]} 0 0
[junit4:junit4] 2> 470549 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38 (1435723443412664320)]} 0 3
[junit4:junit4] 2> 470551 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39 (1435723443417907200)]} 0 0
[junit4:junit4] 2> 470558 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1435723443423150080)]} 0 0
[junit4:junit4] 2> 470559 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[39 (1435723443423150080)]} 0 3
[junit4:junit4] 2> 470559 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39]} 0 5
[junit4:junit4] 2> 470562 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1435723443429441536)]} 0 0
[junit4:junit4] 2> 470567 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1435723443432587264)]} 0 0
[junit4:junit4] 2> 470568 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1435723443432587264)]} 0 3
[junit4:junit4] 2> 470571 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1435723443438878720)]} 0 0
[junit4:junit4] 2> 470578 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1435723443444121600)]} 0 0
[junit4:junit4] 2> 470579 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[41 (1435723443444121600)]} 0 3
[junit4:junit4] 2> 470580 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41]} 0 6
[junit4:junit4] 2> 470582 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1435723443450413056)]} 0 0
[junit4:junit4] 2> 470587 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1435723443453558784)]} 0 0
[junit4:junit4] 2> 470588 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1435723443453558784)]} 0 3
[junit4:junit4] 2> 470591 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1435723443459850240)]} 0 0
[junit4:junit4] 2> 470596 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1435723443462995968)]} 0 0
[junit4:junit4] 2> 470597 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1435723443462995968)]} 0 3
[junit4:junit4] 2> 470600 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1435723443469287424)]} 0 0
[junit4:junit4] 2> 470607 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1435723443474530304)]} 0 0
[junit4:junit4] 2> 470608 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[44 (1435723443474530304)]} 0 3
[junit4:junit4] 2> 470608 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44]} 0 5
[junit4:junit4] 2> 470611 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45 (1435723443480821760)]} 0 0
[junit4:junit4] 2> 470618 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1435723443486064640)]} 0 0
[junit4:junit4] 2> 470619 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[45 (1435723443486064640)]} 0 3
[junit4:junit4] 2> 470620 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45]} 0 6
[junit4:junit4] 2> 470622 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46 (1435723443492356096)]} 0 0
[junit4:junit4] 2> 470627 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1435723443495501824)]} 0 0
[junit4:junit4] 2> 470628 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46 (1435723443495501824)]} 0 3
[junit4:junit4] 2> 470630 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47 (1435723443500744704)]} 0 0
[junit4:junit4] 2> 470635 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1435723443503890432)]} 0 0
[junit4:junit4] 2> 470636 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47 (1435723443503890432)]} 0 3
[junit4:junit4] 2> 470638 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48 (1435723443509133312)]} 0 0
[junit4:junit4] 2> 470645 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1435723443514376192)]} 0 0
[junit4:junit4] 2> 470646 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[48 (1435723443514376192)]} 0 3
[junit4:junit4] 2> 470647 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48]} 0 5
[junit4:junit4] 2> 470649 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49 (1435723443520667648)]} 0 0
[junit4:junit4] 2> 470656 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1435723443525910528)]} 0 0
[junit4:junit4] 2> 470657 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[49 (1435723443525910528)]} 0 3
[junit4:junit4] 2> 470657 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49]} 0 5
[junit4:junit4] 2> 470660 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1435723443532201984)]} 0 0
[junit4:junit4] 2> 470665 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1435723443535347712)]} 0 0
[junit4:junit4] 2> 470666 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1435723443535347712)]} 0 3
[junit4:junit4] 2> 470669 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51 (1435723443541639168)]} 0 0
[junit4:junit4] 2> 470676 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1435723443546882048)]} 0 0
[junit4:junit4] 2> 470677 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[51 (1435723443546882048)]} 0 3
[junit4:junit4] 2> 470677 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51]} 0 5
[junit4:junit4] 2> 470680 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52 (1435723443553173504)]} 0 0
[junit4:junit4] 2> 470685 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1435723443556319232)]} 0 0
[junit4:junit4] 2> 470686 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52 (1435723443556319232)]} 0 3
[junit4:junit4] 2> 470688 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53 (1435723443561562112)]} 0 0
[junit4:junit4] 2> 470695 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1435723443566804992)]} 0 0
[junit4:junit4] 2> 470696 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1435723443566804992)]} 0 3
[junit4:junit4] 2> 470696 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53]} 0 5
[junit4:junit4] 2> 470699 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54 (1435723443573096448)]} 0 0
[junit4:junit4] 2> 470706 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1435723443578339328)]} 0 0
[junit4:junit4] 2> 470707 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[54 (1435723443578339328)]} 0 3
[junit4:junit4] 2> 470707 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54]} 0 5
[junit4:junit4] 2> 470710 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55 (1435723443584630784)]} 0 0
[junit4:junit4] 2> 470715 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1435723443587776512)]} 0 0
[junit4:junit4] 2> 470716 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55 (1435723443587776512)]} 0 3
[junit4:junit4] 2> 470719 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1435723443594067968)]} 0 0
[junit4:junit4] 2> 470724 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1435723443597213696)]} 0 0
[junit4:junit4] 2> 470725 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1435723443597213696)]} 0 3
[junit4:junit4] 2> 470728 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57 (1435723443603505152)]} 0 0
[junit4:junit4] 2> 470735 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1435723443608748032)]} 0 0
[junit4:junit4] 2> 470736 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[57 (1435723443608748032)]} 0 3
[junit4:junit4] 2> 470736 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57]} 0 5
[junit4:junit4] 2> 470739 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58 (1435723443615039488)]} 0 0
[junit4:junit4] 2> 470744 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1435723443618185216)]} 0 0
[junit4:junit4] 2> 470745 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58 (1435723443618185216)]} 0 3
[junit4:junit4] 2> 470747 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59 (1435723443623428096)]} 0 0
[junit4:junit4] 2> 470752 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1435723443626573824)]} 0 0
[junit4:junit4] 2> 470753 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59 (1435723443626573824)]} 0 3
[junit4:junit4] 2> 470756 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60 (1435723443632865280)]} 0 0
[junit4:junit4] 2> 470761 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1435723443636011008)]} 0 0
[junit4:junit4] 2> 470762 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60 (1435723443636011008)]} 0 3
[junit4:junit4] 2> 470764 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61 (1435723443641253888)]} 0 0
[junit4:junit4] 2> 470771 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1435723443646496768)]} 0 0
[junit4:junit4] 2> 470772 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[61 (1435723443646496768)]} 0 3
[junit4:junit4] 2> 470772 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61]} 0 5
[junit4:junit4] 2> 470775 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62 (1435723443652788224)]} 0 0
[junit4:junit4] 2> 470782 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1435723443658031104)]} 0 0
[junit4:junit4] 2> 470783 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[62 (1435723443658031104)]} 0 3
[junit4:junit4] 2> 470783 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62]} 0 5
[junit4:junit4] 2> 470786 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63 (1435723443664322560)]} 0 0
[junit4:junit4] 2> 470793 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1435723443669565440)]} 0 0
[junit4:junit4] 2> 470794 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[63 (1435723443669565440)]} 0 3
[junit4:junit4] 2> 470794 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63]} 0 5
[junit4:junit4] 2> 470797 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64 (1435723443675856896)]} 0 0
[junit4:junit4] 2> 470802 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1435723443679002624)]} 0 0
[junit4:junit4] 2> 470803 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64 (1435723443679002624)]} 0 3
[junit4:junit4] 2> 470806 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65 (1435723443685294080)]} 0 0
[junit4:junit4] 2> 470811 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[65 (1435723443688439808)]} 0 0
[junit4:junit4] 2> 470812 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65 (1435723443688439808)]} 0 3
[junit4:junit4] 2> 470814 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66 (1435723443693682688)]} 0 0
[junit4:junit4] 2> 470821 T1199 C1533 P65368 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[66 (1435723443698925568)]} 0 0
[junit4:junit4] 2> 470822 T1173 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[66 (1435723443698925568)]} 0 3
[junit4:junit4] 2> 470822 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66]} 0 5
[junit4:junit4] 2> 470825 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[67 (1435723443705217024)]} 0 0
[junit4:junit4] 2> 470832 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[67 (1435723443710459904)]} 0 0
[junit4:junit4] 2> 470833 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[67 (1435723443710459904)]} 0 3
[junit4:junit4] 2> 470833 T1171 C1534 P65345 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[67]} 0 5
[junit4:junit4] 2> 470836 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[68 (1435723443716751360)]} 0 0
[junit4:junit4] 2> 470841 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[68 (1435723443719897088)]} 0 0
[junit4:junit4] 2> 470842 T1189 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[68 (1435723443719897088)]} 0 3
[junit4:junit4] 2> 470845 T1147 C1536 P65339 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[69 (1435723443726188544)]} 0 0
[junit4:junit4] 2> 470852 T1218 C1532 P65375 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[69 (1435723443731431424)]} 0 0
[junit4:junit4] 2> 470853 T1187 C1535 P65352 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:65345/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[69 (14357234437
[...truncated too long message...]
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":null,
[junit4:junit4] 2> "core":"collection1_shard1_1_replica1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65368_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65368"}
[junit4:junit4] 2> 707323 T1303 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:65368__collection1_shard1_0_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1_0",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":null,
[junit4:junit4] 2> "core":"collection1_shard1_0_replica1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:65368_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65368"}
[junit4:junit4] 2> 707327 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 707335 T1135 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 65375
[junit4:junit4] 2> 707335 T1135 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1452805835
[junit4:junit4] 2> 708338 T1135 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 708338 T1135 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 708342 T1135 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@208189a6
[junit4:junit4] 2> 708343 T1135 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=804,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 708344 T1135 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 708345 T1135 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 708345 T1135 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 708348 T1135 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 708348 T1135 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 708349 T1135 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index;done=false>>]
[junit4:junit4] 2> 708349 T1135 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4/index
[junit4:junit4] 2> 708368 T1135 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4;done=false>>]
[junit4:junit4] 2> 708368 T1135 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971/jetty4
[junit4:junit4] 2> 708369 T1303 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89732713478815756-127.0.0.1:65375_-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 708372 T1135 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 708443 T1135 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 708445 T1135 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:65329 65329
[junit4:junit4] 2> 708582 T1209 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 708583 T1209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 708583 T1209 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 708585 T1135 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 65339
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369212546971 FAILED !!!!!
[junit4:junit4] 2> 708586 T1135 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 708586 T1135 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:65329 65329
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=BCD13460AF17C0C7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=vi -Dtests.timezone=America/Argentina/San_Luis -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 265s J0 | ChaosMonkeyShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:65345 returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([BCD13460AF17C0C7:3D37BA78D848A0FB]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 708607 T1135 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 264548 T1134 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 709672 T1226 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 709672 T1226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 709672 T1226 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=vi, timezone=America/Argentina/San_Luis
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=220286400,total=450887680
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestRangeQuery, TestRandomFaceting, TestReload, TestQueryTypes, TestBadConfig, TestSystemIdResolver, DocValuesTest, SuggesterTest, ZkControllerTest, RegexBoostProcessorTest, CircularListTest, SchemaVersionSpecificBehaviorTest, TestArbitraryIndexDir, CurrencyFieldOpenExchangeTest, ChaosMonkeyNothingIsSafeTest, DOMUtilTest, XmlUpdateRequestHandlerTest, OutputWriterTest, TestLRUCache, TestSolrQueryParserDefaultOperatorResource, TestLazyCores, TestCSVResponseWriter, TestFieldResource, BadCopyFieldTest, TestManagedSchema, IndexSchemaTest, TestJmxMonitoredMap, TestQuerySenderListener, ConvertedLegacyTest, TestRealTimeGet, PathHierarchyTokenizerFactoryTest, OpenCloseCoreStressTest, SolrInfoMBeanTest, BinaryUpdateRequestHandlerTest, ShardRoutingCustomTest, StandardRequestHandlerTest, MinimalSchemaTest, DirectSolrConnectionTest, EchoParamsTest, SoftAutoCommitTest, TestMultiCoreConfBootstrap, StatsComponentTest, AliasIntegrationTest, XsltUpdateRequestHandlerTest, TestMaxScoreQueryParser, NotRequiredUniqueKeyTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SliceStateTest, TestPluginEnable, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 265.84s, 1 test, 1 error <<< FAILURES!
[...truncated 620 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:386: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:366: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:887: There were test failures: 296 suites, 1234 tests, 1 error, 13 ignored (7 assumptions)
Total time: 49 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure