You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/05/24 21:43:04 UTC
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4014 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4014/
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:51702 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:51702 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([8482E6BFFB22495E:56468A78C7D2962]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 10037 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 1578894 T3923 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 1578900 T3923 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./solrtest-ChaosMonkeyShardSplitTest-1369424338253
[junit4:junit4] 2> 1578902 T3923 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1578903 T3924 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1579003 T3923 oasc.ZkTestServer.run start zk server on port:27250
[junit4:junit4] 2> 1579004 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1579010 T3930 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68837d60 name:ZooKeeperConnection Watcher:127.0.0.1:27250 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1579011 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1579011 T3923 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1579023 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1579025 T3932 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2872cd26 name:ZooKeeperConnection Watcher:127.0.0.1:27250/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1579025 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1579026 T3923 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1579037 T3923 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1579040 T3923 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1579043 T3923 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1579046 T3923 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1579048 T3923 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1579053 T3923 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1579054 T3923 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1579159 T3923 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1579160 T3923 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1579169 T3923 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1579170 T3923 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1579173 T3923 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1579174 T3923 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1579177 T3923 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1579178 T3923 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1579180 T3923 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1579181 T3923 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1579185 T3923 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1579185 T3923 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1579188 T3923 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1579189 T3923 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1579477 T3923 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1579482 T3923 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:50546
[junit4:junit4] 2> 1579483 T3923 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1579483 T3923 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1579484 T3923 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369424338545
[junit4:junit4] 2> 1579484 T3923 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369424338545/solr.xml
[junit4:junit4] 2> 1579485 T3923 oasc.CoreContainer.<init> New CoreContainer 419606898
[junit4:junit4] 2> 1579486 T3923 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369424338545/'
[junit4:junit4] 2> 1579486 T3923 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369424338545/'
[junit4:junit4] 2> 1579623 T3923 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1579624 T3923 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1579625 T3923 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1579625 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1579626 T3923 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1579626 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1579627 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1579628 T3923 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1579628 T3923 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1579629 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1579649 T3923 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1579650 T3923 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:27250/solr
[junit4:junit4] 2> 1579651 T3923 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1579652 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1579655 T3943 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b5ba9dd name:ZooKeeperConnection Watcher:127.0.0.1:27250 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1579656 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1579663 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1579672 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1579674 T3945 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@362de69 name:ZooKeeperConnection Watcher:127.0.0.1:27250/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1579674 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1579677 T3923 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1579687 T3923 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1579690 T3923 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1579698 T3923 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50546_
[junit4:junit4] 2> 1579699 T3923 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50546_
[junit4:junit4] 2> 1579702 T3923 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1579722 T3923 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1579724 T3923 oasc.Overseer.start Overseer (id=89746593432403971-127.0.0.1:50546_-n_0000000000) starting
[junit4:junit4] 2> 1579737 T3923 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1579749 T3947 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1579749 T3923 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1579752 T3923 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1579753 T3923 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1579756 T3946 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1579759 T3948 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369424338545/collection1
[junit4:junit4] 2> 1579759 T3948 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1579760 T3948 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1579760 T3948 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1579761 T3948 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369424338545/collection1/'
[junit4:junit4] 2> 1579763 T3948 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369424338545/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1579764 T3948 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369424338545/collection1/lib/README' to classloader
[junit4:junit4] 2> 1579824 T3948 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1579895 T3948 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1579996 T3948 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1580011 T3948 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1580628 T3948 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1580632 T3948 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1580635 T3948 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1580641 T3948 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1580665 T3948 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1580666 T3948 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369424338545/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/control/data/
[junit4:junit4] 2> 1580666 T3948 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ab84fb1
[junit4:junit4] 2> 1580667 T3948 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1580668 T3948 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/control/data
[junit4:junit4] 2> 1580668 T3948 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/control/data/index/
[junit4:junit4] 2> 1580668 T3948 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1580669 T3948 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/control/data/index
[junit4:junit4] 2> 1580673 T3948 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9b3e6c7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38222c12),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1580674 T3948 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1580677 T3948 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1580677 T3948 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1580678 T3948 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1580678 T3948 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1580679 T3948 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1580679 T3948 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1580680 T3948 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1580680 T3948 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1580681 T3948 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1580696 T3948 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1580703 T3948 oass.SolrIndexSearcher.<init> Opening Searcher@36de7fdb main
[junit4:junit4] 2> 1580704 T3948 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/control/data/tlog
[junit4:junit4] 2> 1580705 T3948 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1580705 T3948 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1580709 T3949 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@36de7fdb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1580711 T3948 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1580712 T3948 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1581259 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1581260 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50546_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50546"}
[junit4:junit4] 2> 1581260 T3946 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1581261 T3946 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1581274 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1581727 T3948 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1581727 T3948 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50546 collection:control_collection shard:shard1
[junit4:junit4] 2> 1581728 T3948 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1581744 T3948 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1581747 T3948 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1581747 T3948 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1581748 T3948 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50546/collection1/
[junit4:junit4] 2> 1581748 T3948 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1581748 T3948 oasc.SyncStrategy.syncToMe http://127.0.0.1:50546/collection1/ has no replicas
[junit4:junit4] 2> 1581748 T3948 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50546/collection1/
[junit4:junit4] 2> 1581749 T3948 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1582778 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1582839 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1582876 T3948 oasc.ZkController.register We are http://127.0.0.1:50546/collection1/ and leader is http://127.0.0.1:50546/collection1/
[junit4:junit4] 2> 1582876 T3948 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50546
[junit4:junit4] 2> 1582876 T3948 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1582877 T3948 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1582877 T3948 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1582879 T3948 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1582880 T3923 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1582881 T3923 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1582881 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1582898 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1582900 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1582902 T3952 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2616d652 name:ZooKeeperConnection Watcher:127.0.0.1:27250/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1582903 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1582905 T3923 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1582907 T3923 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1583177 T3923 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1583180 T3923 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51702
[junit4:junit4] 2> 1583181 T3923 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1583182 T3923 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1583182 T3923 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369424342259
[junit4:junit4] 2> 1583183 T3923 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369424342259/solr.xml
[junit4:junit4] 2> 1583183 T3923 oasc.CoreContainer.<init> New CoreContainer 566776093
[junit4:junit4] 2> 1583184 T3923 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369424342259/'
[junit4:junit4] 2> 1583185 T3923 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369424342259/'
[junit4:junit4] 2> 1583312 T3923 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1583313 T3923 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1583314 T3923 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1583314 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1583315 T3923 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1583315 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1583316 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1583316 T3923 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1583317 T3923 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1583318 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1583334 T3923 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1583335 T3923 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:27250/solr
[junit4:junit4] 2> 1583335 T3923 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1583336 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1583339 T3963 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@221b0a3a name:ZooKeeperConnection Watcher:127.0.0.1:27250 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1583340 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1583342 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1583354 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1583356 T3965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77447eec name:ZooKeeperConnection Watcher:127.0.0.1:27250/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1583357 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1583368 T3923 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1584349 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1584350 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50546_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50546"}
[junit4:junit4] 2> 1584363 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1584363 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1584363 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1584372 T3923 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51702_
[junit4:junit4] 2> 1584374 T3923 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51702_
[junit4:junit4] 2> 1584376 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1584376 T3952 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1584376 T3965 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1584377 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1584377 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1584377 T3945 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1584390 T3966 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369424342259/collection1
[junit4:junit4] 2> 1584390 T3966 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1584391 T3966 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1584391 T3966 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1584393 T3966 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369424342259/collection1/'
[junit4:junit4] 2> 1584394 T3966 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369424342259/collection1/lib/README' to classloader
[junit4:junit4] 2> 1584395 T3966 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369424342259/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1584453 T3966 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1584522 T3966 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1584623 T3966 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1584636 T3966 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1585218 T3966 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1585221 T3966 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1585223 T3966 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1585227 T3966 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1585248 T3966 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1585248 T3966 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369424342259/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty1/
[junit4:junit4] 2> 1585248 T3966 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ab84fb1
[junit4:junit4] 2> 1585249 T3966 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1585249 T3966 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty1
[junit4:junit4] 2> 1585249 T3966 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty1/index/
[junit4:junit4] 2> 1585250 T3966 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1585251 T3966 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty1/index
[junit4:junit4] 2> 1585253 T3966 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31d2f5c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b8cb3cd),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1585253 T3966 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1585256 T3966 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1585256 T3966 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1585256 T3966 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1585257 T3966 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1585257 T3966 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1585258 T3966 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1585258 T3966 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1585258 T3966 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1585259 T3966 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1585270 T3966 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1585275 T3966 oass.SolrIndexSearcher.<init> Opening Searcher@5daf3e43 main
[junit4:junit4] 2> 1585275 T3966 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty1/tlog
[junit4:junit4] 2> 1585276 T3966 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1585276 T3966 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1585279 T3967 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5daf3e43 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1585280 T3966 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1585281 T3966 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1585868 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1585869 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51702_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51702"}
[junit4:junit4] 2> 1585869 T3946 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1585869 T3946 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1585882 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1585882 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1585882 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1586312 T3966 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1586312 T3966 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51702 collection:collection1 shard:shard1
[junit4:junit4] 2> 1586313 T3966 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1586329 T3966 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1586340 T3966 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1586340 T3966 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1586341 T3966 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51702/collection1/
[junit4:junit4] 2> 1586341 T3966 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1586341 T3966 oasc.SyncStrategy.syncToMe http://127.0.0.1:51702/collection1/ has no replicas
[junit4:junit4] 2> 1586342 T3966 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51702/collection1/
[junit4:junit4] 2> 1586342 T3966 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1587386 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1587421 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1587421 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1587421 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1587470 T3966 oasc.ZkController.register We are http://127.0.0.1:51702/collection1/ and leader is http://127.0.0.1:51702/collection1/
[junit4:junit4] 2> 1587470 T3966 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51702
[junit4:junit4] 2> 1587470 T3966 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1587471 T3966 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1587471 T3966 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1587473 T3966 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1587474 T3923 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1587475 T3923 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1587476 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1587762 T3923 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1587765 T3923 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:47041
[junit4:junit4] 2> 1587766 T3923 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1587766 T3923 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1587767 T3923 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369424346849
[junit4:junit4] 2> 1587768 T3923 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369424346849/solr.xml
[junit4:junit4] 2> 1587768 T3923 oasc.CoreContainer.<init> New CoreContainer 1238066889
[junit4:junit4] 2> 1587769 T3923 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369424346849/'
[junit4:junit4] 2> 1587769 T3923 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369424346849/'
[junit4:junit4] 2> 1587897 T3923 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1587898 T3923 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1587899 T3923 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1587899 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1587900 T3923 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1587900 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1587901 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1587901 T3923 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1587902 T3923 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1587902 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1587920 T3923 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1587921 T3923 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:27250/solr
[junit4:junit4] 2> 1587922 T3923 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1587923 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1587929 T3979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@384964c5 name:ZooKeeperConnection Watcher:127.0.0.1:27250 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1587929 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1587932 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1587945 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1587947 T3981 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d8faaaa name:ZooKeeperConnection Watcher:127.0.0.1:27250/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1587947 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1587959 T3923 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1588927 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1588928 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51702_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51702"}
[junit4:junit4] 2> 1588944 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1588944 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1588944 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1588944 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1588962 T3923 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47041_
[junit4:junit4] 2> 1588964 T3923 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47041_
[junit4:junit4] 2> 1588967 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1588967 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1588968 T3965 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1588967 T3952 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1588968 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1588968 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1588969 T3945 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1588975 T3981 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1588980 T3982 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369424346849/collection1
[junit4:junit4] 2> 1588980 T3982 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1588981 T3982 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1588981 T3982 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1588983 T3982 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369424346849/collection1/'
[junit4:junit4] 2> 1588984 T3982 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369424346849/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1588985 T3982 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369424346849/collection1/lib/README' to classloader
[junit4:junit4] 2> 1589044 T3982 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1589138 T3982 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1589239 T3982 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1589250 T3982 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1589853 T3982 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1589857 T3982 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1589860 T3982 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1589865 T3982 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1589888 T3982 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1589888 T3982 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369424346849/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty2/
[junit4:junit4] 2> 1589889 T3982 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ab84fb1
[junit4:junit4] 2> 1589889 T3982 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1589890 T3982 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty2
[junit4:junit4] 2> 1589890 T3982 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty2/index/
[junit4:junit4] 2> 1589891 T3982 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1589891 T3982 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty2/index
[junit4:junit4] 2> 1589895 T3982 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41681cad lockFactory=org.apache.lucene.store.NativeFSLockFactory@759b7b52),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1589896 T3982 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1589899 T3982 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1589899 T3982 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1589900 T3982 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1589901 T3982 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1589901 T3982 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1589901 T3982 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1589902 T3982 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1589903 T3982 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1589903 T3982 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1589919 T3982 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1589927 T3982 oass.SolrIndexSearcher.<init> Opening Searcher@7aabf486 main
[junit4:junit4] 2> 1589927 T3982 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty2/tlog
[junit4:junit4] 2> 1589929 T3982 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1589929 T3982 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1589934 T3983 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7aabf486 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1589936 T3982 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1589936 T3982 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1590449 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1590450 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47041_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47041"}
[junit4:junit4] 2> 1590450 T3946 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1590450 T3946 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1590462 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1590462 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1590462 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1590462 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1590939 T3982 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1590939 T3982 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47041 collection:collection1 shard:shard2
[junit4:junit4] 2> 1590940 T3982 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1590965 T3982 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1590968 T3982 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1590968 T3982 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1590969 T3982 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47041/collection1/
[junit4:junit4] 2> 1590969 T3982 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1590969 T3982 oasc.SyncStrategy.syncToMe http://127.0.0.1:47041/collection1/ has no replicas
[junit4:junit4] 2> 1590970 T3982 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47041/collection1/
[junit4:junit4] 2> 1590970 T3982 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1591966 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1591982 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1591982 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1591982 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1591982 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1592002 T3982 oasc.ZkController.register We are http://127.0.0.1:47041/collection1/ and leader is http://127.0.0.1:47041/collection1/
[junit4:junit4] 2> 1592002 T3982 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47041
[junit4:junit4] 2> 1592002 T3982 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1592003 T3982 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1592003 T3982 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1592004 T3982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1592006 T3923 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1592006 T3923 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1592007 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1592290 T3923 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1592293 T3923 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:18937
[junit4:junit4] 2> 1592294 T3923 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1592295 T3923 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1592295 T3923 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369424351375
[junit4:junit4] 2> 1592296 T3923 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369424351375/solr.xml
[junit4:junit4] 2> 1592296 T3923 oasc.CoreContainer.<init> New CoreContainer 1685899699
[junit4:junit4] 2> 1592297 T3923 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369424351375/'
[junit4:junit4] 2> 1592298 T3923 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369424351375/'
[junit4:junit4] 2> 1592441 T3923 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1592442 T3923 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1592443 T3923 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1592443 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1592444 T3923 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1592444 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1592445 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1592445 T3923 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1592446 T3923 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1592447 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1592463 T3923 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1592464 T3923 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:27250/solr
[junit4:junit4] 2> 1592464 T3923 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1592465 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1592468 T3995 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@333b698d name:ZooKeeperConnection Watcher:127.0.0.1:27250 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1592469 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1592471 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1592483 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1592485 T3997 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16b5171c name:ZooKeeperConnection Watcher:127.0.0.1:27250/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1592485 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1592542 T3923 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1593495 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1593496 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47041_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47041"}
[junit4:junit4] 2> 1593512 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1593512 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1593512 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1593512 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1593512 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1593545 T3923 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18937_
[junit4:junit4] 2> 1593547 T3923 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18937_
[junit4:junit4] 2> 1593549 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1593549 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1593550 T3965 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1593550 T3997 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1593550 T3952 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1593550 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1593550 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1593551 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1593551 T3945 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1593558 T3981 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1593564 T3998 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369424351375/collection1
[junit4:junit4] 2> 1593564 T3998 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1593564 T3998 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1593565 T3998 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1593566 T3998 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369424351375/collection1/'
[junit4:junit4] 2> 1593568 T3998 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369424351375/collection1/lib/README' to classloader
[junit4:junit4] 2> 1593568 T3998 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369424351375/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1593617 T3998 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1593675 T3998 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1593777 T3998 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1593788 T3998 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1594348 T3998 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1594353 T3998 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1594355 T3998 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1594361 T3998 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1594383 T3998 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1594384 T3998 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369424351375/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3/
[junit4:junit4] 2> 1594384 T3998 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ab84fb1
[junit4:junit4] 2> 1594384 T3998 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1594386 T3998 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3
[junit4:junit4] 2> 1594386 T3998 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3/index/
[junit4:junit4] 2> 1594386 T3998 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1594387 T3998 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3/index
[junit4:junit4] 2> 1594391 T3998 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e705e99 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6fa0bc6d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1594391 T3998 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1594394 T3998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1594395 T3998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1594395 T3998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1594396 T3998 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1594397 T3998 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1594397 T3998 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1594398 T3998 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1594398 T3998 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1594399 T3998 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1594415 T3998 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1594423 T3998 oass.SolrIndexSearcher.<init> Opening Searcher@1018750b main
[junit4:junit4] 2> 1594423 T3998 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3/tlog
[junit4:junit4] 2> 1594424 T3998 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1594425 T3998 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1594429 T3999 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1018750b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1594431 T3998 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1594432 T3998 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1595017 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1595018 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:18937_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:18937"}
[junit4:junit4] 2> 1595019 T3946 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1595019 T3946 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1595034 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1595035 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1595035 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1595034 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1595034 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1595459 T3998 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1595459 T3998 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18937 collection:collection1 shard:shard1
[junit4:junit4] 2> 1595462 T3998 oasc.ZkController.register We are http://127.0.0.1:18937/collection1/ and leader is http://127.0.0.1:51702/collection1/
[junit4:junit4] 2> 1595463 T3998 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18937
[junit4:junit4] 2> 1595463 T3998 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1595463 T3998 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1914 name=collection1 org.apache.solr.core.SolrCore@5d775f11 url=http://127.0.0.1:18937/collection1 node=127.0.0.1:18937_ C1914_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:18937_, base_url=http://127.0.0.1:18937}
[junit4:junit4] 2> 1595464 T4000 C1914 P18937 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1595465 T3998 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1595465 T4000 C1914 P18937 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1595465 T4000 C1914 P18937 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1595466 T4000 C1914 P18937 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1595466 T3923 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1595467 T3923 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1595467 T4000 C1914 P18937 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1595467 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1595492 T3955 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1595754 T3923 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1595757 T3923 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:14393
[junit4:junit4] 2> 1595758 T3923 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1595759 T3923 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1595759 T3923 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369424354843
[junit4:junit4] 2> 1595760 T3923 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369424354843/solr.xml
[junit4:junit4] 2> 1595760 T3923 oasc.CoreContainer.<init> New CoreContainer 1685872516
[junit4:junit4] 2> 1595761 T3923 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369424354843/'
[junit4:junit4] 2> 1595762 T3923 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369424354843/'
[junit4:junit4] 2> 1595890 T3923 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1595891 T3923 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1595891 T3923 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1595892 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1595892 T3923 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1595893 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1595893 T3923 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1595894 T3923 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1595894 T3923 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1595895 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1595913 T3923 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1595914 T3923 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:27250/solr
[junit4:junit4] 2> 1595914 T3923 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1595915 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1595919 T4012 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c296ed6 name:ZooKeeperConnection Watcher:127.0.0.1:27250 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1595919 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1595932 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1595945 T3923 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1595947 T4014 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14e41552 name:ZooKeeperConnection Watcher:127.0.0.1:27250/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1595947 T3923 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1595952 T3923 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1596538 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1596539 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:18937_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:18937"}
[junit4:junit4] 2> 1596552 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1596552 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1596552 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1596552 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1596552 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1596552 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1596955 T3923 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:14393_
[junit4:junit4] 2> 1596957 T3923 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:14393_
[junit4:junit4] 2> 1596959 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1596960 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1596960 T3965 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1596960 T3997 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1596960 T3952 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1596960 T4014 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1596961 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1596961 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1596960 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1596961 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1596969 T3945 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1596969 T3981 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1596974 T4015 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369424354843/collection1
[junit4:junit4] 2> 1596975 T4015 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1596975 T4015 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1596975 T4015 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1596977 T4015 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369424354843/collection1/'
[junit4:junit4] 2> 1596979 T4015 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369424354843/collection1/lib/README' to classloader
[junit4:junit4] 2> 1596979 T4015 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369424354843/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1597031 T4015 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1597093 T4015 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1597195 T4015 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1597206 T4015 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1597494 T3955 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1597494 T3955 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:18937_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 1597793 T4015 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1597797 T4015 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1597799 T4015 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1597805 T4015 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1597827 T4015 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1597827 T4015 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369424354843/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/
[junit4:junit4] 2> 1597828 T4015 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ab84fb1
[junit4:junit4] 2> 1597828 T4015 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1597829 T4015 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4
[junit4:junit4] 2> 1597829 T4015 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index/
[junit4:junit4] 2> 1597830 T4015 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1597831 T4015 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index
[junit4:junit4] 2> 1597834 T4015 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33267331 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fa9ccf9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1597834 T4015 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1597837 T4015 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1597838 T4015 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1597838 T4015 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1597839 T4015 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1597840 T4015 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1597840 T4015 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1597840 T4015 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1597841 T4015 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1597841 T4015 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1597857 T4015 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1597864 T4015 oass.SolrIndexSearcher.<init> Opening Searcher@3010083c main
[junit4:junit4] 2> 1597864 T4015 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/tlog
[junit4:junit4] 2> 1597865 T4015 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1597866 T4015 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1597870 T4016 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3010083c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1597873 T4015 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1597873 T4015 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1598057 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1598058 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14393_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14393"}
[junit4:junit4] 2> 1598058 T3946 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1598058 T3946 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1598075 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1598075 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1598075 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1598075 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1598075 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1598075 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1598881 T4015 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1598881 T4015 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:14393 collection:collection1 shard:shard2
[junit4:junit4] 2> 1598913 T4015 oasc.ZkController.register We are http://127.0.0.1:14393/collection1/ and leader is http://127.0.0.1:47041/collection1/
[junit4:junit4] 2> 1598913 T4015 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:14393
[junit4:junit4] 2> 1598913 T4015 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1598913 T4015 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1915 name=collection1 org.apache.solr.core.SolrCore@67b6d698 url=http://127.0.0.1:14393/collection1 node=127.0.0.1:14393_ C1915_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:14393_, base_url=http://127.0.0.1:14393}
[junit4:junit4] 2> 1598914 T4017 C1915 P14393 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1598914 T4015 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1598915 T4017 C1915 P14393 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1598915 T4017 C1915 P14393 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1598915 T4017 C1915 P14393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1598916 T3923 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1598916 T3923 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1598917 T4017 C1915 P14393 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1598917 T3923 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1598935 T3923 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1598936 T3971 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1598937 T3923 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1598937 T3923 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1598938 T3923 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C1916 name=collection1 org.apache.solr.core.SolrCore@5d775f11 url=http://127.0.0.1:18937/collection1 node=127.0.0.1:18937_ C1916_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:18937_, base_url=http://127.0.0.1:18937}
[junit4:junit4] 2> 1599496 T4000 C1916 P18937 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51702/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1599496 T4000 C1916 P18937 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:18937 START replicas=[http://127.0.0.1:51702/collection1/] nUpdates=100
[junit4:junit4] 2> 1599497 T4000 C1916 P18937 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1599498 T4000 C1916 P18937 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1599498 T4000 C1916 P18937 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1599498 T4000 C1916 P18937 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1599499 T4000 C1916 P18937 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1599499 T4000 C1916 P18937 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51702/collection1/. core=collection1
[junit4:junit4] 2> 1599499 T4000 C1916 P18937 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1917 name=collection1 org.apache.solr.core.SolrCore@62f1422e url=http://127.0.0.1:51702/collection1 node=127.0.0.1:51702_ C1917_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51702_, base_url=http://127.0.0.1:51702, leader=true}
[junit4:junit4] 2> 1599506 T3956 C1917 P51702 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1599512 T3957 C1917 P51702 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1599514 T3957 C1917 P51702 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31d2f5c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b8cb3cd),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1599515 T3957 C1917 P51702 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1599515 T3957 C1917 P51702 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31d2f5c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b8cb3cd),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31d2f5c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b8cb3cd),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1599516 T3957 C1917 P51702 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1599516 T3957 C1917 P51702 oass.SolrIndexSearcher.<init> Opening Searcher@2c88a135 realtime
[junit4:junit4] 2> 1599517 T3957 C1917 P51702 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1599517 T3957 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1599518 T4000 C1916 P18937 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1599519 T4000 C1916 P18937 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1599521 T3958 C1917 P51702 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1599521 T3958 C1917 P51702 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1599522 T4000 C1916 P18937 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1599522 T4000 C1916 P18937 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1599523 T4000 C1916 P18937 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1599525 T3958 C1917 P51702 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1599526 T4000 C1916 P18937 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1599526 T4000 C1916 P18937 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3/index.20130524133918878
[junit4:junit4] 2> 1599527 T4000 C1916 P18937 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@42d4c14f lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a31675e) fullCopy=false
[junit4:junit4] 2> 1599529 T3958 C1917 P51702 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1599530 T4000 C1916 P18937 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1599531 T4000 C1916 P18937 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1599531 T4000 C1916 P18937 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1599533 T4000 C1916 P18937 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e705e99 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6fa0bc6d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e705e99 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6fa0bc6d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1599534 T4000 C1916 P18937 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1599534 T4000 C1916 P18937 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1599535 T4000 C1916 P18937 oass.SolrIndexSearcher.<init> Opening Searcher@5b3318b2 main
[junit4:junit4] 2> 1599536 T3999 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5b3318b2 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1599536 T4000 C1916 P18937 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3/index.20130524133918878 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3/index.20130524133918878;done=true>>]
[junit4:junit4] 2> 1599537 T4000 C1916 P18937 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3/index.20130524133918878
[junit4:junit4] 2> 1599537 T4000 C1916 P18937 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty3/index.20130524133918878
[junit4:junit4] 2> 1599537 T4000 C1916 P18937 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1599537 T4000 C1916 P18937 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1599538 T4000 C1916 P18937 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1599538 T4000 C1916 P18937 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1599540 T4000 C1916 P18937 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1599579 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1599580 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14393_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14393"}
[junit4:junit4] 2> 1599583 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:18937_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:18937"}
[junit4:junit4] 2> 1599595 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1599595 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1599595 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1599595 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1599595 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1599595 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1599938 T3971 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1599938 T3971 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:14393_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 1599940 T3923 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1600942 T3923 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C1915_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:14393_, base_url=http://127.0.0.1:14393}
[junit4:junit4] 2> 1601940 T4017 C1915 P14393 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:47041/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1601940 T4017 C1915 P14393 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14393 START replicas=[http://127.0.0.1:47041/collection1/] nUpdates=100
[junit4:junit4] 2> 1601941 T4017 C1915 P14393 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1601941 T4017 C1915 P14393 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1601942 T4017 C1915 P14393 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1601942 T4017 C1915 P14393 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1601942 T4017 C1915 P14393 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1601943 T4017 C1915 P14393 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:47041/collection1/. core=collection1
[junit4:junit4] 2> 1601943 T4017 C1915 P14393 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1601944 T3923 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C1918 name=collection1 org.apache.solr.core.SolrCore@ba26977 url=http://127.0.0.1:47041/collection1 node=127.0.0.1:47041_ C1918_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:47041_, base_url=http://127.0.0.1:47041, leader=true}
[junit4:junit4] 2> 1601950 T3972 C1918 P47041 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1601956 T3973 C1918 P47041 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1601958 T3973 C1918 P47041 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41681cad lockFactory=org.apache.lucene.store.NativeFSLockFactory@759b7b52),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1601959 T3973 C1918 P47041 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1601959 T3973 C1918 P47041 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41681cad lockFactory=org.apache.lucene.store.NativeFSLockFactory@759b7b52),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41681cad lockFactory=org.apache.lucene.store.NativeFSLockFactory@759b7b52),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1601960 T3973 C1918 P47041 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1601961 T3973 C1918 P47041 oass.SolrIndexSearcher.<init> Opening Searcher@579590c6 realtime
[junit4:junit4] 2> 1601961 T3973 C1918 P47041 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1601961 T3973 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 1601962 T4017 C1915 P14393 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1601963 T4017 C1915 P14393 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1601965 T3974 C1918 P47041 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1601966 T3974 C1918 P47041 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1601966 T4017 C1915 P14393 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1601967 T4017 C1915 P14393 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1601967 T4017 C1915 P14393 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1601969 T3974 C1918 P47041 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1601970 T4017 C1915 P14393 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1601971 T4017 C1915 P14393 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index.20130524133921322
[junit4:junit4] 2> 1601971 T4017 C1915 P14393 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@61008847 lockFactory=org.apache.lucene.store.NativeFSLockFactory@690fd024) fullCopy=false
[junit4:junit4] 2> 1601974 T3974 C1918 P47041 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1601975 T4017 C1915 P14393 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1601976 T4017 C1915 P14393 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1601976 T4017 C1915 P14393 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1601978 T4017 C1915 P14393 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33267331 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fa9ccf9),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33267331 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fa9ccf9),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1601978 T4017 C1915 P14393 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1601979 T4017 C1915 P14393 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1601979 T4017 C1915 P14393 oass.SolrIndexSearcher.<init> Opening Searcher@6da9d8c4 main
[junit4:junit4] 2> 1601980 T4016 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6da9d8c4 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1601981 T4017 C1915 P14393 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index.20130524133921322 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index.20130524133921322;done=true>>]
[junit4:junit4] 2> 1601982 T4017 C1915 P14393 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index.20130524133921322
[junit4:junit4] 2> 1601982 T4017 C1915 P14393 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index.20130524133921322
[junit4:junit4] 2> 1601982 T4017 C1915 P14393 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1601982 T4017 C1915 P14393 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1601983 T4017 C1915 P14393 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1601983 T4017 C1915 P14393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1601985 T4017 C1915 P14393 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1602602 T3946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1602603 T3946 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14393_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14393"}
[junit4:junit4] 2> 1602682 T3945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602682 T3997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602682 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602682 T3981 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602682 T3965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602682 T3952 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602946 T3923 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1602947 T3923 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C1919 name=collection1 org.apache.solr.core.SolrCore@1813e671 url=http://127.0.0.1:50546/collection1 node=127.0.0.1:50546_ C1919_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:50546_, base_url=http://127.0.0.1:50546, leader=true}
[junit4:junit4] 2> 1602955 T3935 C1919 P50546 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1602958 T3935 C1919 P50546 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9b3e6c7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38222c12),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1602958 T3935 C1919 P50546 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1602959 T3935 C1919 P50546 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9b3e6c7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38222c12),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9b3e6c7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38222c12),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1602960 T3935 C1919 P50546 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1602960 T3935 C1919 P50546 oass.SolrIndexSearcher.<init> Opening Searcher@44737548 main
[junit4:junit4] 2> 1602961 T3935 C1919 P50546 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1602962 T3949 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@44737548 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1602962 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1602974 T3959 C1917 P51702 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1602975 T3959 C1917 P51702 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31d2f5c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b8cb3cd),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@31d2f5c1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b8cb3cd),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1602976 T3959 C1917 P51702 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1602976 T3959 C1917 P51702 oass.SolrIndexSearcher.<init> Opening Searcher@7abfdc50 main
[junit4:junit4] 2> 1602977 T3959 C1917 P51702 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1602978 T3967 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7abfdc50 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1602978 T3959 C1917 P51702 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:18937/collection1/, StdNode: http://127.0.0.1:47041/collection1/, StdNode: http://127.0.0.1:14393/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1602981 T3975 C1918 P47041 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1602982 T3975 C1918 P47041 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41681cad lockFactory=org.apache.lucene.store.NativeFSLockFactory@759b7b52),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@41681cad lockFactory=org.apache.lucene.store.NativeFSLockFactory@759b7b52),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1602983 T3975 C1918 P47041 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1602983 T3975 C1918 P47041 oass.SolrIndexSearcher.<init> Opening Searcher@26931a17 main
[junit4:junit4] 2> 1602984 T3975 C1918 P47041 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1602984 T3983 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@26931a17 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1602985 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> C1916_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:18937_, base_url=http://127.0.0.1:18937}
[junit4:junit4] 2> 1602988 T3987 C1916 P18937 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C1915_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:14393_, base_url=http://127.0.0.1:14393}
[junit4:junit4] 2> 1602988 T4004 C1915 P14393 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1602989 T3987 C1916 P18937 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e705e99 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6fa0bc6d),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e705e99 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6fa0bc6d),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1602989 T4004 C1915 P14393 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33267331 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fa9ccf9),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33267331 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fa9ccf9),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1602990 T3987 C1916 P18937 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1602990 T4004 C1915 P14393 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1602991 T3987 C1916 P18937 oass.SolrIndexSearcher.<init> Opening Searcher@32532c0e main
[junit4:junit4] 2> 1602992 T4004 C1915 P14393 oass.SolrIndexSearcher.<init> Opening Searcher@44381c80 main
[junit4:junit4] 2> 1602992 T3987 C1916 P18937 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1602993 T3999 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32532c0e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1602993 T4004 C1915 P14393 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1602993 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 1602993 T4016 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@44381c80 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1602995 T4004 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1602995 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4] 2> 1602996 T3923 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1602999 T3960 C1917 P51702 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1603001 T3988 C1916 P18937 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1603003 T3976 C1918 P47041 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1603004 T4005 C1915 P14393 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1605010 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435945522283151360)} 0 2
[junit4:junit4] 2> 1605018 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435945522287345664&update.from=http://127.0.0.1:47041/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435945522287345664)} 0 2
[junit4:junit4] 2> 1605021 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435945522291539968&update.from=http://127.0.0.1:51702/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435945522291539968)} 0 1
[junit4:junit4] 2> 1605022 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435945522291539968)} 0 6
[junit4:junit4] 2> 1605023 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435945522287345664)} 0 11
[junit4:junit4] 2> 1605027 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1435945522302025728)]} 0 1
[junit4:junit4] 2> 1605035 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435945522307268608)]} 0 1
[junit4:junit4] 2> 1605035 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1435945522307268608)]} 0 4
[junit4:junit4] 2> 1605036 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0]} 0 7
[junit4:junit4] 2> 1605039 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1435945522315657216)]} 0 0
[junit4:junit4] 2> 1605046 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435945522320900096)]} 0 0
[junit4:junit4] 2> 1605047 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1435945522320900096)]} 0 3
[junit4:junit4] 2> 1605047 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1]} 0 5
[junit4:junit4] 2> 1605050 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1435945522327191552)]} 0 0
[junit4:junit4] 2> 1605059 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435945522332434432)]} 0 1
[junit4:junit4] 2> 1605059 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1435945522332434432)]} 0 4
[junit4:junit4] 2> 1605060 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2]} 0 7
[junit4:junit4] 2> 1605062 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1435945522339774464)]} 0 0
[junit4:junit4] 2> 1605069 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435945522345017344)]} 0 0
[junit4:junit4] 2> 1605070 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1435945522345017344)]} 0 3
[junit4:junit4] 2> 1605070 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3]} 0 5
[junit4:junit4] 2> 1605073 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435945522351308800)]} 0 0
[junit4:junit4] 2> 1605078 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435945522354454528)]} 0 0
[junit4:junit4] 2> 1605079 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1435945522354454528)]} 0 3
[junit4:junit4] 2> 1605082 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1435945522360745984)]} 0 0
[junit4:junit4] 2> 1605089 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435945522365988864)]} 0 0
[junit4:junit4] 2> 1605090 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1435945522365988864)]} 0 3
[junit4:junit4] 2> 1605091 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5]} 0 6
[junit4:junit4] 2> 1605093 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1435945522372280320)]} 0 0
[junit4:junit4] 2> 1605100 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435945522377523200)]} 0 0
[junit4:junit4] 2> 1605101 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1435945522377523200)]} 0 3
[junit4:junit4] 2> 1605102 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6]} 0 6
[junit4:junit4] 2> 1605104 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1435945522383814656)]} 0 0
[junit4:junit4] 2> 1605111 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435945522389057536)]} 0 0
[junit4:junit4] 2> 1605112 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1435945522389057536)]} 0 3
[junit4:junit4] 2> 1605113 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7]} 0 6
[junit4:junit4] 2> 1605115 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435945522395348992)]} 0 0
[junit4:junit4] 2> 1605120 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435945522398494720)]} 0 0
[junit4:junit4] 2> 1605121 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1435945522398494720)]} 0 3
[junit4:junit4] 2> 1605124 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1435945522404786176)]} 0 0
[junit4:junit4] 2> 1605131 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435945522410029056)]} 0 0
[junit4:junit4] 2> 1605132 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1435945522410029056)]} 0 3
[junit4:junit4] 2> 1605133 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9]} 0 6
[junit4:junit4] 2> 1605135 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1435945522416320512)]} 0 0
[junit4:junit4] 2> 1605142 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435945522421563392)]} 0 0
[junit4:junit4] 2> 1605143 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1435945522421563392)]} 0 3
[junit4:junit4] 2> 1605144 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10]} 0 6
[junit4:junit4] 2> 1605146 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1435945522427854848)]} 0 0
[junit4:junit4] 2> 1605153 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435945522433097728)]} 0 0
[junit4:junit4] 2> 1605154 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1435945522433097728)]} 0 3
[junit4:junit4] 2> 1605155 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11]} 0 6
[junit4:junit4] 2> 1605157 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1435945522439389184)]} 0 0
[junit4:junit4] 2> 1605162 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435945522442534912)]} 0 0
[junit4:junit4] 2> 1605163 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1435945522442534912)]} 0 3
[junit4:junit4] 2> 1605166 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1435945522448826368)]} 0 0
[junit4:junit4] 2> 1605173 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435945522454069248)]} 0 0
[junit4:junit4] 2> 1605174 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[13 (1435945522454069248)]} 0 3
[junit4:junit4] 2> 1605175 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13]} 0 6
[junit4:junit4] 2> 1605177 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1435945522460360704)]} 0 0
[junit4:junit4] 2> 1605182 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435945522463506432)]} 0 0
[junit4:junit4] 2> 1605183 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1435945522463506432)]} 0 3
[junit4:junit4] 2> 1605186 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435945522469797888)]} 0 0
[junit4:junit4] 2> 1605191 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435945522472943616)]} 0 0
[junit4:junit4] 2> 1605192 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1435945522472943616)]} 0 3
[junit4:junit4] 2> 1605195 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1435945522479235072)]} 0 0
[junit4:junit4] 2> 1605200 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435945522482380800)]} 0 0
[junit4:junit4] 2> 1605201 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1435945522482380800)]} 0 3
[junit4:junit4] 2> 1605204 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1435945522488672256)]} 0 0
[junit4:junit4] 2> 1605211 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435945522493915136)]} 0 0
[junit4:junit4] 2> 1605212 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1435945522493915136)]} 0 3
[junit4:junit4] 2> 1605213 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17]} 0 6
[junit4:junit4] 2> 1605215 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1435945522500206592)]} 0 0
[junit4:junit4] 2> 1605222 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435945522505449472)]} 0 0
[junit4:junit4] 2> 1605223 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[18 (1435945522505449472)]} 0 3
[junit4:junit4] 2> 1605224 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18]} 0 6
[junit4:junit4] 2> 1605226 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1435945522511740928)]} 0 0
[junit4:junit4] 2> 1605233 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435945522516983808)]} 0 0
[junit4:junit4] 2> 1605234 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[19 (1435945522516983808)]} 0 3
[junit4:junit4] 2> 1605235 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19]} 0 6
[junit4:junit4] 2> 1605237 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1435945522523275264)]} 0 0
[junit4:junit4] 2> 1605244 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435945522528518144)]} 0 0
[junit4:junit4] 2> 1605245 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[20 (1435945522528518144)]} 0 3
[junit4:junit4] 2> 1605246 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20]} 0 6
[junit4:junit4] 2> 1605248 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1435945522534809600)]} 0 0
[junit4:junit4] 2> 1605253 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435945522537955328)]} 0 0
[junit4:junit4] 2> 1605254 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1435945522537955328)]} 0 3
[junit4:junit4] 2> 1605257 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1435945522544246784)]} 0 0
[junit4:junit4] 2> 1605264 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435945522549489664)]} 0 0
[junit4:junit4] 2> 1605265 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1435945522549489664)]} 0 3
[junit4:junit4] 2> 1605266 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22]} 0 6
[junit4:junit4] 2> 1605268 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1435945522555781120)]} 0 0
[junit4:junit4] 2> 1605275 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435945522561024000)]} 0 0
[junit4:junit4] 2> 1605276 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[23 (1435945522561024000)]} 0 3
[junit4:junit4] 2> 1605276 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23]} 0 5
[junit4:junit4] 2> 1605279 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24 (1435945522567315456)]} 0 0
[junit4:junit4] 2> 1605286 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435945522572558336)]} 0 0
[junit4:junit4] 2> 1605287 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[24 (1435945522572558336)]} 0 3
[junit4:junit4] 2> 1605287 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24]} 0 5
[junit4:junit4] 2> 1605290 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1435945522578849792)]} 0 0
[junit4:junit4] 2> 1605295 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435945522581995520)]} 0 0
[junit4:junit4] 2> 1605296 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1435945522581995520)]} 0 3
[junit4:junit4] 2> 1605300 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26 (1435945522588286976)]} 0 0
[junit4:junit4] 2> 1605307 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435945522594578432)]} 0 0
[junit4:junit4] 2> 1605308 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1435945522594578432)]} 0 3
[junit4:junit4] 2> 1605309 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26]} 0 6
[junit4:junit4] 2> 1605311 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27 (1435945522600869888)]} 0 0
[junit4:junit4] 2> 1605318 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435945522606112768)]} 0 0
[junit4:junit4] 2> 1605319 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[27 (1435945522606112768)]} 0 3
[junit4:junit4] 2> 1605320 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27]} 0 6
[junit4:junit4] 2> 1605322 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28 (1435945522612404224)]} 0 0
[junit4:junit4] 2> 1605327 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435945522615549952)]} 0 0
[junit4:junit4] 2> 1605328 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28 (1435945522615549952)]} 0 3
[junit4:junit4] 2> 1605332 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1435945522621841408)]} 0 1
[junit4:junit4] 2> 1605336 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435945522624987136)]} 0 0
[junit4:junit4] 2> 1605337 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1435945522624987136)]} 0 3
[junit4:junit4] 2> 1605340 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1435945522631278592)]} 0 0
[junit4:junit4] 2> 1605347 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435945522636521472)]} 0 0
[junit4:junit4] 2> 1605348 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[30 (1435945522636521472)]} 0 3
[junit4:junit4] 2> 1605349 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30]} 0 6
[junit4:junit4] 2> 1605351 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1435945522642812928)]} 0 0
[junit4:junit4] 2> 1605356 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435945522645958656)]} 0 0
[junit4:junit4] 2> 1605357 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1435945522645958656)]} 0 3
[junit4:junit4] 2> 1605360 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1435945522652250112)]} 0 0
[junit4:junit4] 2> 1605367 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435945522657492992)]} 0 0
[junit4:junit4] 2> 1605368 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[32 (1435945522657492992)]} 0 3
[junit4:junit4] 2> 1605369 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32]} 0 6
[junit4:junit4] 2> 1605371 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1435945522663784448)]} 0 0
[junit4:junit4] 2> 1605376 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435945522666930176)]} 0 0
[junit4:junit4] 2> 1605377 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1435945522666930176)]} 0 3
[junit4:junit4] 2> 1605380 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34 (1435945522673221632)]} 0 0
[junit4:junit4] 2> 1605387 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1435945522678464512)]} 0 0
[junit4:junit4] 2> 1605388 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[34 (1435945522678464512)]} 0 3
[junit4:junit4] 2> 1605389 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34]} 0 6
[junit4:junit4] 2> 1605392 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35 (1435945522685804544)]} 0 0
[junit4:junit4] 2> 1605399 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1435945522691047424)]} 0 0
[junit4:junit4] 2> 1605400 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[35 (1435945522691047424)]} 0 3
[junit4:junit4] 2> 1605401 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35]} 0 6
[junit4:junit4] 2> 1605403 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36 (1435945522697338880)]} 0 0
[junit4:junit4] 2> 1605411 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1435945522702581760)]} 0 1
[junit4:junit4] 2> 1605411 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[36 (1435945522702581760)]} 0 3
[junit4:junit4] 2> 1605412 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36]} 0 6
[junit4:junit4] 2> 1605415 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37 (1435945522709921792)]} 0 0
[junit4:junit4] 2> 1605420 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1435945522713067520)]} 0 0
[junit4:junit4] 2> 1605421 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37 (1435945522713067520)]} 0 3
[junit4:junit4] 2> 1605424 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38 (1435945522719358976)]} 0 0
[junit4:junit4] 2> 1605429 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1435945522722504704)]} 0 0
[junit4:junit4] 2> 1605430 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38 (1435945522722504704)]} 0 3
[junit4:junit4] 2> 1605433 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39 (1435945522728796160)]} 0 0
[junit4:junit4] 2> 1605438 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1435945522731941888)]} 0 0
[junit4:junit4] 2> 1605439 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39 (1435945522731941888)]} 0 3
[junit4:junit4] 2> 1605441 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1435945522737184768)]} 0 0
[junit4:junit4] 2> 1605446 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1435945522740330496)]} 0 0
[junit4:junit4] 2> 1605447 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1435945522740330496)]} 0 3
[junit4:junit4] 2> 1605450 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1435945522746621952)]} 0 0
[junit4:junit4] 2> 1605455 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1435945522749767680)]} 0 0
[junit4:junit4] 2> 1605456 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1435945522749767680)]} 0 3
[junit4:junit4] 2> 1605458 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1435945522755010560)]} 0 0
[junit4:junit4] 2> 1605463 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1435945522758156288)]} 0 0
[junit4:junit4] 2> 1605464 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1435945522758156288)]} 0 3
[junit4:junit4] 2> 1605466 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1435945522763399168)]} 0 0
[junit4:junit4] 2> 1605473 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1435945522768642048)]} 0 0
[junit4:junit4] 2> 1605474 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[43 (1435945522768642048)]} 0 3
[junit4:junit4] 2> 1605474 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43]} 0 5
[junit4:junit4] 2> 1605477 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1435945522774933504)]} 0 0
[junit4:junit4] 2> 1605482 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1435945522778079232)]} 0 0
[junit4:junit4] 2> 1605483 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1435945522778079232)]} 0 3
[junit4:junit4] 2> 1605485 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45 (1435945522783322112)]} 0 0
[junit4:junit4] 2> 1605492 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1435945522788564992)]} 0 0
[junit4:junit4] 2> 1605493 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[45 (1435945522788564992)]} 0 3
[junit4:junit4] 2> 1605493 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45]} 0 5
[junit4:junit4] 2> 1605496 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46 (1435945522794856448)]} 0 0
[junit4:junit4] 2> 1605501 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1435945522798002176)]} 0 0
[junit4:junit4] 2> 1605502 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46 (1435945522798002176)]} 0 3
[junit4:junit4] 2> 1605504 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47 (1435945522803245056)]} 0 0
[junit4:junit4] 2> 1605509 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1435945522806390784)]} 0 0
[junit4:junit4] 2> 1605510 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47 (1435945522806390784)]} 0 3
[junit4:junit4] 2> 1605512 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48 (1435945522811633664)]} 0 0
[junit4:junit4] 2> 1605519 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1435945522816876544)]} 0 0
[junit4:junit4] 2> 1605520 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[48 (1435945522816876544)]} 0 3
[junit4:junit4] 2> 1605520 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48]} 0 5
[junit4:junit4] 2> 1605523 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49 (1435945522823168000)]} 0 0
[junit4:junit4] 2> 1605530 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1435945522828410880)]} 0 0
[junit4:junit4] 2> 1605531 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[49 (1435945522828410880)]} 0 3
[junit4:junit4] 2> 1605531 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49]} 0 5
[junit4:junit4] 2> 1605534 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1435945522834702336)]} 0 0
[junit4:junit4] 2> 1605539 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1435945522837848064)]} 0 0
[junit4:junit4] 2> 1605540 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1435945522837848064)]} 0 3
[junit4:junit4] 2> 1605543 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51 (1435945522844139520)]} 0 0
[junit4:junit4] 2> 1605548 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1435945522847285248)]} 0 0
[junit4:junit4] 2> 1605549 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51 (1435945522847285248)]} 0 3
[junit4:junit4] 2> 1605551 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52 (1435945522852528128)]} 0 0
[junit4:junit4] 2> 1605558 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1435945522857771008)]} 0 0
[junit4:junit4] 2> 1605559 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[52 (1435945522857771008)]} 0 3
[junit4:junit4] 2> 1605559 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52]} 0 5
[junit4:junit4] 2> 1605562 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53 (1435945522864062464)]} 0 0
[junit4:junit4] 2> 1605569 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1435945522869305344)]} 0 0
[junit4:junit4] 2> 1605570 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1435945522869305344)]} 0 3
[junit4:junit4] 2> 1605570 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53]} 0 5
[junit4:junit4] 2> 1605573 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54 (1435945522875596800)]} 0 0
[junit4:junit4] 2> 1605580 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1435945522880839680)]} 0 0
[junit4:junit4] 2> 1605581 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[54 (1435945522880839680)]} 0 3
[junit4:junit4] 2> 1605581 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54]} 0 5
[junit4:junit4] 2> 1605584 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55 (1435945522887131136)]} 0 0
[junit4:junit4] 2> 1605591 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1435945522892374016)]} 0 0
[junit4:junit4] 2> 1605592 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[55 (1435945522892374016)]} 0 3
[junit4:junit4] 2> 1605592 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55]} 0 5
[junit4:junit4] 2> 1605595 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1435945522898665472)]} 0 0
[junit4:junit4] 2> 1605600 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1435945522901811200)]} 0 0
[junit4:junit4] 2> 1605601 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1435945522901811200)]} 0 3
[junit4:junit4] 2> 1605603 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57 (1435945522907054080)]} 0 0
[junit4:junit4] 2> 1605608 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1435945522910199808)]} 0 0
[junit4:junit4] 2> 1605609 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57 (1435945522910199808)]} 0 3
[junit4:junit4] 2> 1605610 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58 (1435945522914394112)]} 0 0
[junit4:junit4] 2> 1605615 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1435945522917539840)]} 0 0
[junit4:junit4] 2> 1605616 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58 (1435945522917539840)]} 0 3
[junit4:junit4] 2> 1605619 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59 (1435945522923831296)]} 0 0
[junit4:junit4] 2> 1605626 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1435945522929074176)]} 0 0
[junit4:junit4] 2> 1605627 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[59 (1435945522929074176)]} 0 3
[junit4:junit4] 2> 1605628 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59]} 0 6
[junit4:junit4] 2> 1605631 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60 (1435945522936414208)]} 0 0
[junit4:junit4] 2> 1605637 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1435945522939559936)]} 0 0
[junit4:junit4] 2> 1605638 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60 (1435945522939559936)]} 0 4
[junit4:junit4] 2> 1605641 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61 (1435945522946899968)]} 0 0
[junit4:junit4] 2> 1605648 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1435945522952142848)]} 0 0
[junit4:junit4] 2> 1605649 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[61 (1435945522952142848)]} 0 3
[junit4:junit4] 2> 1605649 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61]} 0 5
[junit4:junit4] 2> 1605652 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62 (1435945522958434304)]} 0 0
[junit4:junit4] 2> 1605659 T4006 C1915 P14393 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1435945522963677184)]} 0 0
[junit4:junit4] 2> 1605660 T3975 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[62 (1435945522963677184)]} 0 3
[junit4:junit4] 2> 1605660 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62]} 0 5
[junit4:junit4] 2> 1605663 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63 (1435945522969968640)]} 0 0
[junit4:junit4] 2> 1605670 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1435945522975211520)]} 0 0
[junit4:junit4] 2> 1605671 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[63 (1435945522975211520)]} 0 3
[junit4:junit4] 2> 1605671 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63]} 0 5
[junit4:junit4] 2> 1605674 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64 (1435945522981502976)]} 0 0
[junit4:junit4] 2> 1605681 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1435945522986745856)]} 0 0
[junit4:junit4] 2> 1605682 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[64 (1435945522986745856)]} 0 3
[junit4:junit4] 2> 1605682 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64]} 0 5
[junit4:junit4] 2> 1605685 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65 (1435945522993037312)]} 0 0
[junit4:junit4] 2> 1605690 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[65 (1435945522996183040)]} 0 0
[junit4:junit4] 2> 1605691 T3959 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65 (1435945522996183040)]} 0 3
[junit4:junit4] 2> 1605693 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66 (1435945523001425920)]} 0 0
[junit4:junit4] 2> 1605700 T3987 C1916 P18937 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51702/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[66 (1435945523006668800)]} 0 0
[junit4:junit4] 2> 1605701 T3961 C1917 P51702 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:47041/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[66 (1435945523006668800)]} 0 3
[junit4:junit4] 2> 1605701 T3977 C1918 P47041 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66]} 0 5
[junit4:junit4] 2> 1605704 T3935 C1919 P50546 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/upda
[...truncated too long message...]
oseIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1810936 T4014 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1810936 T4014 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1810936 T4014 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4;done=false>>]
[junit4:junit4] 2> 1810937 T4014 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4
[junit4:junit4] 2> 1810937 T4014 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index;done=false>>]
[junit4:junit4] 2> 1810937 T4014 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369424338252/jetty4/index
[junit4:junit4] 2> 1810937 T4014 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1810938 T4014 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89746593432403980-5-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1810938 T4014 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1810939 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1810939 T4014 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1810939 T4014 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1810939 T4014 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1810940 T4014 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=101), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=101)), sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=pl, timezone=America/Costa_Rica
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=3,free=305074368,total=476053504
[junit4:junit4] 2> NOTE: All tests run in this JVM: [IndexReaderFactoryTest, DocumentAnalysisRequestHandlerTest, TestOmitPositions, UpdateParamsTest, ChaosMonkeySafeLeaderTest, IndexSchemaRuntimeFieldTest, TestReload, DOMUtilTest, DirectSolrSpellCheckerTest, TestStressReorder, TestCodecSupport, CopyFieldTest, ConvertedLegacyTest, XmlUpdateRequestHandlerTest, TestSerializedLuceneMatchVersion, BasicDistributedZk2Test, BasicZkTest, TestCSVResponseWriter, SortByFunctionTest, TestSuggestSpellingConverter, NoCacheHeaderTest, ClusterStateTest, SolrCoreCheckLockOnStartupTest, TestCSVLoader, SuggesterWFSTTest, TestElisionMultitermQuery, HighlighterTest, DocValuesMultiTest, URLClassifyProcessorTest, HighlighterConfigTest, TestFiltering, TestBinaryField, TestQuerySenderNoQuery, DirectUpdateHandlerTest, TestSolrJ, TestDefaultSimilarityFactory, RequestHandlersTest, TestComponentsName, CollectionsAPIDistributedZkTest, SpellPossibilityIteratorTest, TermVectorComponentDistributedTest, SolrCmdDistributorTest, UniqFieldsUpdateProcessorFactoryTest, TestRTGBase, SuggesterTSTTest, TestDistributedGrouping, OpenCloseCoreStressTest, TestMergePolicyConfig, JSONWriterTest, TestMaxScoreQueryParser, TestAnalyzedSuggestions, TestRecovery, TestSystemIdResolver, RequiredFieldsTest, TestLuceneMatchVersion, TestJmxIntegration, DisMaxRequestHandlerTest, SampleTest, PathHierarchyTokenizerFactoryTest, TestSchemaSimilarityResource, MultiTermTest, TestQueryTypes, SpellCheckCollatorTest, TestCollationField, ZkSolrClientTest, EchoParamsTest, LeaderElectionIntegrationTest, TestLazyCores, TestDFRSimilarityFactory, SyncSliceTest, TestReplicationHandler, TestZkChroot, TestRandomDVFaceting, AutoCommitTest, TestHashPartitioner, TestRealTimeGet, TestSolr4Spatial, SolrCoreTest, TestGroupingSearch, TestBadConfig, SoftAutoCommitTest, CurrencyFieldXmlFileTest, SolrRequestParserTest, TestStressLucene, SpatialFilterTest, SchemaVersionSpecificBehaviorTest, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, StatelessScriptUpdateProcessorFactoryTest, DistanceFunctionTest, SolrInfoMBeanTest, DebugComponentTest, IndexBasedSpellCheckerTest, TestWriterPerf, TestIndexingPerformance, TestArbitraryIndexDir, FastVectorHighlighterTest, ReturnFieldsTest, QueryParsingTest, PingRequestHandlerTest, CoreContainerCoreInitFailuresTest, SOLR749Test, TestQuerySenderListener, TestSolrIndexConfig, SolrIndexConfigTest, NumericFieldsTest, OutputWriterTest, TestPostingsSolrHighlighter, TestXIncludeConfig, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestFastWriter, TestJmxMonitoredMap, TimeZoneUtilsTest, ResourceLoaderTest, OpenExchangeRatesOrgProviderTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, PreAnalyzedFieldTest, TestUtils, ZkNodePropsTest, UUIDFieldTest, SolrTestCaseJ4Test, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J1 in 232.56s, 1 test, 1 error <<< FAILURES!
[...truncated 10 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:380: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:360: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 error, 13 ignored (7 assumptions)
Total time: 50 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4017 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4017/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:63494 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:63494 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([40EB31A9E3F5D5DF:C10DBFB194AAB5E3]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9651 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 1583761 T2876 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 1583767 T2876 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1369522780135
[junit4:junit4] 2> 1583769 T2876 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1583769 T2877 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1583870 T2876 oasc.ZkTestServer.run start zk server on port:63487
[junit4:junit4] 2> 1583871 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1583875 T2883 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f751d72 name:ZooKeeperConnection Watcher:127.0.0.1:63487 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1583875 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1583876 T2876 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1583890 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1583892 T2885 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2360580f name:ZooKeeperConnection Watcher:127.0.0.1:63487/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1583892 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1583893 T2876 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1583902 T2876 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1583904 T2876 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1583913 T2876 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1583916 T2876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1583917 T2876 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1583927 T2876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1583928 T2876 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1584032 T2876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1584033 T2876 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1584042 T2876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1584043 T2876 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1584045 T2876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1584046 T2876 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1584049 T2876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1584050 T2876 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1584052 T2876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1584053 T2876 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1584061 T2876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1584062 T2876 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1584065 T2876 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1584065 T2876 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1584341 T2876 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1584345 T2876 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:63490
[junit4:junit4] 2> 1584346 T2876 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1584347 T2876 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1584347 T2876 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369522780442
[junit4:junit4] 2> 1584348 T2876 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369522780442/solr.xml
[junit4:junit4] 2> 1584348 T2876 oasc.CoreContainer.<init> New CoreContainer 1928964781
[junit4:junit4] 2> 1584349 T2876 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369522780442/'
[junit4:junit4] 2> 1584350 T2876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369522780442/'
[junit4:junit4] 2> 1584500 T2876 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1584501 T2876 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1584502 T2876 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1584503 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1584503 T2876 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1584504 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1584504 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1584505 T2876 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1584505 T2876 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1584506 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1584524 T2876 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1584525 T2876 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63487/solr
[junit4:junit4] 2> 1584525 T2876 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1584526 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1584530 T2896 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f569b71 name:ZooKeeperConnection Watcher:127.0.0.1:63487 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1584530 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1584533 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1584544 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1584546 T2898 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@107212d8 name:ZooKeeperConnection Watcher:127.0.0.1:63487/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1584546 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1584548 T2876 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1584559 T2876 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1584562 T2876 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1584569 T2876 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63490_
[junit4:junit4] 2> 1584570 T2876 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63490_
[junit4:junit4] 2> 1584577 T2876 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1584590 T2876 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1584597 T2876 oasc.Overseer.start Overseer (id=89753044919386115-127.0.0.1:63490_-n_0000000000) starting
[junit4:junit4] 2> 1584601 T2876 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1584633 T2900 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1584633 T2876 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1584644 T2876 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1584646 T2876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1584648 T2899 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1584652 T2901 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369522780442/collection1
[junit4:junit4] 2> 1584652 T2901 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1584653 T2901 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1584653 T2901 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1584654 T2901 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369522780442/collection1/'
[junit4:junit4] 2> 1584656 T2901 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369522780442/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1584657 T2901 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369522780442/collection1/lib/README' to classloader
[junit4:junit4] 2> 1584715 T2901 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1584779 T2901 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1584881 T2901 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1584887 T2901 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1585487 T2901 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1585490 T2901 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1585491 T2901 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1585495 T2901 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1585514 T2901 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1585514 T2901 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369522780442/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/control/data/
[junit4:junit4] 2> 1585515 T2901 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7dee05dc
[junit4:junit4] 2> 1585515 T2901 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1585516 T2901 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/control/data
[junit4:junit4] 2> 1585516 T2901 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/control/data/index/
[junit4:junit4] 2> 1585516 T2901 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1585516 T2901 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/control/data/index
[junit4:junit4] 2> 1585520 T2901 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5c75460f lockFactory=org.apache.lucene.store.NativeFSLockFactory@251017c7)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1585520 T2901 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1585522 T2901 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1585522 T2901 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1585523 T2901 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1585523 T2901 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1585524 T2901 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1585524 T2901 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1585524 T2901 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1585525 T2901 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1585525 T2901 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1585536 T2901 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1585542 T2901 oass.SolrIndexSearcher.<init> Opening Searcher@21f55f5e main
[junit4:junit4] 2> 1585542 T2901 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/control/data/tlog
[junit4:junit4] 2> 1585543 T2901 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1585543 T2901 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1585546 T2902 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@21f55f5e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1585546 T2901 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1585547 T2901 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1586152 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1586153 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63490_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63490"}
[junit4:junit4] 2> 1586153 T2899 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1586154 T2899 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1586169 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1586549 T2901 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1586549 T2901 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:63490 collection:control_collection shard:shard1
[junit4:junit4] 2> 1586551 T2901 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1586671 T2901 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1586699 T2901 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1586700 T2901 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1586700 T2901 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63490/collection1/
[junit4:junit4] 2> 1586700 T2901 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1586700 T2901 oasc.SyncStrategy.syncToMe http://127.0.0.1:63490/collection1/ has no replicas
[junit4:junit4] 2> 1586700 T2901 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63490/collection1/
[junit4:junit4] 2> 1586701 T2901 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1587672 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1587705 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1587768 T2901 oasc.ZkController.register We are http://127.0.0.1:63490/collection1/ and leader is http://127.0.0.1:63490/collection1/
[junit4:junit4] 2> 1587768 T2901 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63490
[junit4:junit4] 2> 1587768 T2901 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1587769 T2901 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1587769 T2901 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1587771 T2901 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1587772 T2876 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1587773 T2876 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1587773 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1587784 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1587785 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1587787 T2905 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18082755 name:ZooKeeperConnection Watcher:127.0.0.1:63487/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1587788 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1587789 T2876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1587791 T2876 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1588088 T2876 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1588092 T2876 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:63494
[junit4:junit4] 2> 1588092 T2876 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1588093 T2876 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1588094 T2876 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369522784158
[junit4:junit4] 2> 1588094 T2876 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369522784158/solr.xml
[junit4:junit4] 2> 1588095 T2876 oasc.CoreContainer.<init> New CoreContainer 1846337251
[junit4:junit4] 2> 1588095 T2876 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369522784158/'
[junit4:junit4] 2> 1588096 T2876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369522784158/'
[junit4:junit4] 2> 1588231 T2876 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1588231 T2876 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1588232 T2876 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1588232 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1588233 T2876 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1588233 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1588234 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1588234 T2876 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1588235 T2876 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1588236 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1588253 T2876 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1588254 T2876 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63487/solr
[junit4:junit4] 2> 1588254 T2876 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1588255 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1588258 T2916 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73f2ac96 name:ZooKeeperConnection Watcher:127.0.0.1:63487 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1588259 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1588275 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1588285 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1588288 T2918 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@25eae711 name:ZooKeeperConnection Watcher:127.0.0.1:63487/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1588288 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1588299 T2876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1589221 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1589222 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63490_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63490"}
[junit4:junit4] 2> 1589236 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1589236 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1589236 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1589302 T2876 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63494_
[junit4:junit4] 2> 1589304 T2876 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63494_
[junit4:junit4] 2> 1589306 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1589306 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1589306 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1589308 T2918 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1589308 T2905 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1589316 T2898 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1589322 T2919 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369522784158/collection1
[junit4:junit4] 2> 1589322 T2919 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1589323 T2919 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1589323 T2919 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1589325 T2919 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369522784158/collection1/'
[junit4:junit4] 2> 1589326 T2919 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369522784158/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1589327 T2919 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369522784158/collection1/lib/README' to classloader
[junit4:junit4] 2> 1589384 T2919 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1589449 T2919 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1589550 T2919 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1589557 T2919 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1590073 T2919 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1590078 T2919 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1590080 T2919 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1590085 T2919 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1590106 T2919 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1590107 T2919 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369522784158/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty1/
[junit4:junit4] 2> 1590107 T2919 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7dee05dc
[junit4:junit4] 2> 1590107 T2919 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1590108 T2919 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty1
[junit4:junit4] 2> 1590108 T2919 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty1/index/
[junit4:junit4] 2> 1590109 T2919 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1590110 T2919 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty1/index
[junit4:junit4] 2> 1590113 T2919 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1110bbb1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4db60ec5)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1590114 T2919 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1590117 T2919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1590117 T2919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1590118 T2919 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1590119 T2919 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1590119 T2919 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1590120 T2919 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1590120 T2919 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1590121 T2919 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1590121 T2919 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1590138 T2919 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1590145 T2919 oass.SolrIndexSearcher.<init> Opening Searcher@4551326 main
[junit4:junit4] 2> 1590146 T2919 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty1/tlog
[junit4:junit4] 2> 1590147 T2919 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1590147 T2919 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1590151 T2920 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4551326 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1590153 T2919 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1590154 T2919 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1590740 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1590741 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63494_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63494"}
[junit4:junit4] 2> 1590741 T2899 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1590742 T2899 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1590757 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1590757 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1590757 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1591156 T2919 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1591156 T2919 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:63494 collection:collection1 shard:shard1
[junit4:junit4] 2> 1591157 T2919 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1591176 T2919 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1591188 T2919 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1591188 T2919 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1591188 T2919 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63494/collection1/
[junit4:junit4] 2> 1591188 T2919 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1591188 T2919 oasc.SyncStrategy.syncToMe http://127.0.0.1:63494/collection1/ has no replicas
[junit4:junit4] 2> 1591189 T2919 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63494/collection1/
[junit4:junit4] 2> 1591189 T2919 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1592262 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1592282 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1592282 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1592282 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1592325 T2919 oasc.ZkController.register We are http://127.0.0.1:63494/collection1/ and leader is http://127.0.0.1:63494/collection1/
[junit4:junit4] 2> 1592325 T2919 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63494
[junit4:junit4] 2> 1592325 T2919 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1592325 T2919 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1592326 T2919 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1592327 T2919 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1592328 T2876 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1592329 T2876 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1592330 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1592626 T2876 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1592629 T2876 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:63497
[junit4:junit4] 2> 1592630 T2876 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1592631 T2876 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1592631 T2876 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369522788713
[junit4:junit4] 2> 1592632 T2876 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369522788713/solr.xml
[junit4:junit4] 2> 1592632 T2876 oasc.CoreContainer.<init> New CoreContainer 257980270
[junit4:junit4] 2> 1592633 T2876 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369522788713/'
[junit4:junit4] 2> 1592634 T2876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369522788713/'
[junit4:junit4] 2> 1592791 T2876 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1592792 T2876 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1592792 T2876 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1592793 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1592793 T2876 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1592794 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1592794 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1592795 T2876 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1592795 T2876 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1592796 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1592814 T2876 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1592814 T2876 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63487/solr
[junit4:junit4] 2> 1592815 T2876 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1592816 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1592819 T2932 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@462d51e3 name:ZooKeeperConnection Watcher:127.0.0.1:63487 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1592820 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1592831 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1592842 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1592845 T2934 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2af32394 name:ZooKeeperConnection Watcher:127.0.0.1:63487/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1592845 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1592854 T2876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1593793 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1593794 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63494_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63494"}
[junit4:junit4] 2> 1593816 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1593816 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1593816 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1593816 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1593857 T2876 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63497_
[junit4:junit4] 2> 1593859 T2876 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63497_
[junit4:junit4] 2> 1593861 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1593861 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1593861 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1593861 T2934 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1593862 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1593862 T2918 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1593870 T2898 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1593870 T2905 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1593874 T2935 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369522788713/collection1
[junit4:junit4] 2> 1593875 T2935 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1593875 T2935 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1593875 T2935 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1593876 T2935 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369522788713/collection1/'
[junit4:junit4] 2> 1593878 T2935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369522788713/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1593878 T2935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369522788713/collection1/lib/README' to classloader
[junit4:junit4] 2> 1593916 T2935 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1593961 T2935 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1594062 T2935 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1594066 T2935 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1594476 T2935 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1594479 T2935 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1594481 T2935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1594485 T2935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1594503 T2935 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1594504 T2935 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369522788713/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty2/
[junit4:junit4] 2> 1594504 T2935 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7dee05dc
[junit4:junit4] 2> 1594504 T2935 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1594505 T2935 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty2
[junit4:junit4] 2> 1594505 T2935 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty2/index/
[junit4:junit4] 2> 1594506 T2935 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1594506 T2935 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty2/index
[junit4:junit4] 2> 1594509 T2935 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f32a52f lockFactory=org.apache.lucene.store.NativeFSLockFactory@612c4ede)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1594509 T2935 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1594511 T2935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1594512 T2935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1594512 T2935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1594513 T2935 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1594513 T2935 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1594513 T2935 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1594514 T2935 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1594514 T2935 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1594514 T2935 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1594526 T2935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1594531 T2935 oass.SolrIndexSearcher.<init> Opening Searcher@8f23bf8 main
[junit4:junit4] 2> 1594531 T2935 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty2/tlog
[junit4:junit4] 2> 1594532 T2935 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1594533 T2935 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1594536 T2936 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@8f23bf8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1594538 T2935 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1594538 T2935 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1595320 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1595321 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63497_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63497"}
[junit4:junit4] 2> 1595321 T2899 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1595322 T2899 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1595335 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1595335 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1595335 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1595335 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1595541 T2935 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1595541 T2935 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:63497 collection:collection1 shard:shard2
[junit4:junit4] 2> 1595542 T2935 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1595559 T2935 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1595571 T2935 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1595571 T2935 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1595572 T2935 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63497/collection1/
[junit4:junit4] 2> 1595572 T2935 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1595572 T2935 oasc.SyncStrategy.syncToMe http://127.0.0.1:63497/collection1/ has no replicas
[junit4:junit4] 2> 1595572 T2935 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63497/collection1/
[junit4:junit4] 2> 1595573 T2935 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1596839 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1596868 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1596868 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1596868 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1596868 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1596912 T2935 oasc.ZkController.register We are http://127.0.0.1:63497/collection1/ and leader is http://127.0.0.1:63497/collection1/
[junit4:junit4] 2> 1596912 T2935 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63497
[junit4:junit4] 2> 1596912 T2935 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1596912 T2935 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1596913 T2935 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1596919 T2935 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1596920 T2876 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1596921 T2876 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1596921 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1597162 T2876 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1597165 T2876 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:44996
[junit4:junit4] 2> 1597165 T2876 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1597166 T2876 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1597166 T2876 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369522793302
[junit4:junit4] 2> 1597167 T2876 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369522793302/solr.xml
[junit4:junit4] 2> 1597167 T2876 oasc.CoreContainer.<init> New CoreContainer 202701023
[junit4:junit4] 2> 1597168 T2876 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369522793302/'
[junit4:junit4] 2> 1597168 T2876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369522793302/'
[junit4:junit4] 2> 1597277 T2876 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1597278 T2876 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1597278 T2876 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1597279 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1597279 T2876 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1597280 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1597280 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1597280 T2876 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1597281 T2876 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1597281 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1597295 T2876 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1597296 T2876 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63487/solr
[junit4:junit4] 2> 1597296 T2876 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1597297 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1597325 T2948 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28afc1c8 name:ZooKeeperConnection Watcher:127.0.0.1:63487 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1597326 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1597339 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1597349 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1597351 T2950 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23445a5 name:ZooKeeperConnection Watcher:127.0.0.1:63487/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1597351 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1597361 T2876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1598365 T2876 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44996_
[junit4:junit4] 2> 1598367 T2876 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44996_
[junit4:junit4] 2> 1598370 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1598370 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1598370 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1598370 T2934 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1598370 T2950 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1598371 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1598381 T2898 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1598381 T2905 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1598382 T2918 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1598382 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1598383 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63497_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63497"}
[junit4:junit4] 2> 1598386 T2951 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369522793302/collection1
[junit4:junit4] 2> 1598386 T2951 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1598395 T2950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1598395 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1598395 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1598395 T2951 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1598395 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1598395 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1598396 T2951 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1598398 T2951 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369522793302/collection1/'
[junit4:junit4] 2> 1598399 T2951 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369522793302/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1598400 T2951 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369522793302/collection1/lib/README' to classloader
[junit4:junit4] 2> 1598455 T2951 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1598524 T2951 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1598626 T2951 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1598631 T2951 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1599098 T2951 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1599101 T2951 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1599103 T2951 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1599108 T2951 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1599142 T2951 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1599142 T2951 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369522793302/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3/
[junit4:junit4] 2> 1599143 T2951 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7dee05dc
[junit4:junit4] 2> 1599143 T2951 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1599144 T2951 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3
[junit4:junit4] 2> 1599144 T2951 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3/index/
[junit4:junit4] 2> 1599144 T2951 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1599145 T2951 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3/index
[junit4:junit4] 2> 1599148 T2951 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@17ae5e4c lockFactory=org.apache.lucene.store.NativeFSLockFactory@3461c06a)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1599148 T2951 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1599151 T2951 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1599151 T2951 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1599152 T2951 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1599152 T2951 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1599153 T2951 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1599153 T2951 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1599153 T2951 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1599154 T2951 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1599154 T2951 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1599166 T2951 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1599173 T2951 oass.SolrIndexSearcher.<init> Opening Searcher@2dd7d5d6 main
[junit4:junit4] 2> 1599173 T2951 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3/tlog
[junit4:junit4] 2> 1599174 T2951 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1599174 T2951 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1599177 T2952 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2dd7d5d6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1599179 T2951 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1599179 T2951 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1599899 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1599900 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44996_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44996"}
[junit4:junit4] 2> 1599900 T2899 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1599901 T2899 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1599913 T2950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1599913 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1599913 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1599913 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1599913 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1600182 T2951 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1600182 T2951 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44996 collection:collection1 shard:shard1
[junit4:junit4] 2> 1600185 T2951 oasc.ZkController.register We are http://127.0.0.1:44996/collection1/ and leader is http://127.0.0.1:63494/collection1/
[junit4:junit4] 2> 1600186 T2951 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44996
[junit4:junit4] 2> 1600186 T2951 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1600186 T2951 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C782 name=collection1 org.apache.solr.core.SolrCore@10c70cdc url=http://127.0.0.1:44996/collection1 node=127.0.0.1:44996_ C782_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:44996_, base_url=http://127.0.0.1:44996}
[junit4:junit4] 2> 1600187 T2953 C782 P44996 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1600187 T2951 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1600188 T2953 C782 P44996 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1600188 T2953 C782 P44996 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1600188 T2953 C782 P44996 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1600189 T2876 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1600189 T2876 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1600190 T2953 C782 P44996 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1600190 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1600211 T2908 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1600410 T2876 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1600413 T2876 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52286
[junit4:junit4] 2> 1600413 T2876 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1600414 T2876 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1600414 T2876 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369522796576
[junit4:junit4] 2> 1600415 T2876 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369522796576/solr.xml
[junit4:junit4] 2> 1600415 T2876 oasc.CoreContainer.<init> New CoreContainer 1370970310
[junit4:junit4] 2> 1600416 T2876 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369522796576/'
[junit4:junit4] 2> 1600416 T2876 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369522796576/'
[junit4:junit4] 2> 1600515 T2876 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1600516 T2876 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1600516 T2876 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1600516 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1600517 T2876 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1600517 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1600518 T2876 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1600518 T2876 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1600518 T2876 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1600519 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1600532 T2876 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1600533 T2876 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63487/solr
[junit4:junit4] 2> 1600533 T2876 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1600534 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1600537 T2965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e605d87 name:ZooKeeperConnection Watcher:127.0.0.1:63487 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1600538 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1600553 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1600566 T2876 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1600568 T2967 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f6869f5 name:ZooKeeperConnection Watcher:127.0.0.1:63487/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1600569 T2876 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1600577 T2876 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1601417 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1601418 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44996_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44996"}
[junit4:junit4] 2> 1601432 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601432 T2967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601432 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601432 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601432 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601432 T2950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601581 T2876 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52286_
[junit4:junit4] 2> 1601610 T2876 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52286_
[junit4:junit4] 2> 1601634 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601634 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601634 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601634 T2950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601634 T2967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1601634 T2934 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1601635 T2898 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1601636 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1601637 T2905 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1601637 T2918 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1601637 T2950 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1601637 T2967 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1601641 T2968 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369522796576/collection1
[junit4:junit4] 2> 1601642 T2968 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1601642 T2968 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1601643 T2968 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1601644 T2968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369522796576/collection1/'
[junit4:junit4] 2> 1601646 T2968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369522796576/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1601646 T2968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369522796576/collection1/lib/README' to classloader
[junit4:junit4] 2> 1601704 T2968 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1601769 T2968 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1601870 T2968 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1601876 T2968 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1602213 T2908 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1602213 T2908 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:44996_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 1602496 T2968 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1602501 T2968 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1602503 T2968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1602508 T2968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1602528 T2968 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1602528 T2968 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369522796576/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/
[junit4:junit4] 2> 1602529 T2968 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7dee05dc
[junit4:junit4] 2> 1602529 T2968 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1602530 T2968 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4
[junit4:junit4] 2> 1602531 T2968 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index/
[junit4:junit4] 2> 1602531 T2968 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1602532 T2968 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index
[junit4:junit4] 2> 1602535 T2968 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@18a6c51c lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b705848)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1602536 T2968 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1602539 T2968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1602539 T2968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1602540 T2968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1602541 T2968 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1602541 T2968 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1602542 T2968 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1602542 T2968 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1602543 T2968 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1602543 T2968 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1602558 T2968 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1602565 T2968 oass.SolrIndexSearcher.<init> Opening Searcher@5c1b7ca3 main
[junit4:junit4] 2> 1602565 T2968 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/tlog
[junit4:junit4] 2> 1602567 T2968 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1602567 T2968 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1602571 T2969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5c1b7ca3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1602573 T2968 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1602573 T2968 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1602936 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1602937 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52286_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52286"}
[junit4:junit4] 2> 1602937 T2899 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1602937 T2899 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1602953 T2950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602953 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602953 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602953 T2967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602953 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1602953 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1603576 T2968 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1603576 T2968 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52286 collection:collection1 shard:shard2
[junit4:junit4] 2> 1603579 T2968 oasc.ZkController.register We are http://127.0.0.1:52286/collection1/ and leader is http://127.0.0.1:63497/collection1/
[junit4:junit4] 2> 1603579 T2968 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52286
[junit4:junit4] 2> 1603580 T2968 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1603580 T2968 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C783 name=collection1 org.apache.solr.core.SolrCore@52a00007 url=http://127.0.0.1:52286/collection1 node=127.0.0.1:52286_ C783_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52286_, base_url=http://127.0.0.1:52286}
[junit4:junit4] 2> 1603580 T2970 C783 P52286 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1603581 T2968 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1603581 T2970 C783 P52286 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1603582 T2970 C783 P52286 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1603582 T2970 C783 P52286 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1603582 T2876 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1603583 T2876 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1603583 T2970 C783 P52286 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1603584 T2876 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1603600 T2876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1603601 T2924 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1603602 T2876 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1603602 T2876 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1603603 T2876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C784 name=collection1 org.apache.solr.core.SolrCore@10c70cdc url=http://127.0.0.1:44996/collection1 node=127.0.0.1:44996_ C784_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:44996_, base_url=http://127.0.0.1:44996}
[junit4:junit4] 2> 1604215 T2953 C784 P44996 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:63494/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1604215 T2953 C784 P44996 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:44996 START replicas=[http://127.0.0.1:63494/collection1/] nUpdates=100
[junit4:junit4] 2> 1604215 T2953 C784 P44996 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1604216 T2953 C784 P44996 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1604217 T2953 C784 P44996 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1604217 T2953 C784 P44996 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1604217 T2953 C784 P44996 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1604217 T2953 C784 P44996 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:63494/collection1/. core=collection1
[junit4:junit4] 2> 1604217 T2953 C784 P44996 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C785 name=collection1 org.apache.solr.core.SolrCore@63c882b5 url=http://127.0.0.1:63494/collection1 node=127.0.0.1:63494_ C785_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:63494_, base_url=http://127.0.0.1:63494, leader=true}
[junit4:junit4] 2> 1604223 T2909 C785 P63494 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1604226 T2910 C785 P63494 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1604229 T2910 C785 P63494 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1110bbb1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4db60ec5)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1604230 T2910 C785 P63494 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1604230 T2910 C785 P63494 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1110bbb1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4db60ec5)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1110bbb1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4db60ec5)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1604231 T2910 C785 P63494 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1604231 T2910 C785 P63494 oass.SolrIndexSearcher.<init> Opening Searcher@f4c3554 realtime
[junit4:junit4] 2> 1604232 T2910 C785 P63494 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1604232 T2910 C785 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1604233 T2953 C784 P44996 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1604233 T2953 C784 P44996 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1604235 T2911 C785 P63494 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1604235 T2911 C785 P63494 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1604236 T2953 C784 P44996 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1604236 T2953 C784 P44996 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1604236 T2953 C784 P44996 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1604238 T2911 C785 P63494 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1604238 T2953 C784 P44996 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1604239 T2953 C784 P44996 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3/index.20130525160000606
[junit4:junit4] 2> 1604239 T2953 C784 P44996 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@313dd36c lockFactory=org.apache.lucene.store.NativeFSLockFactory@756f896c; maxCacheMB=0.1767578125 maxMergeSizeMB=0.908203125)) fullCopy=false
[junit4:junit4] 2> 1604242 T2911 C785 P63494 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1604243 T2953 C784 P44996 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1604244 T2953 C784 P44996 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1604244 T2953 C784 P44996 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1604245 T2953 C784 P44996 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@17ae5e4c lockFactory=org.apache.lucene.store.NativeFSLockFactory@3461c06a)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@17ae5e4c lockFactory=org.apache.lucene.store.NativeFSLockFactory@3461c06a)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1604246 T2953 C784 P44996 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1604246 T2953 C784 P44996 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1604246 T2953 C784 P44996 oass.SolrIndexSearcher.<init> Opening Searcher@72c5c572 main
[junit4:junit4] 2> 1604247 T2952 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@72c5c572 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1604248 T2953 C784 P44996 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3/index.20130525160000606 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3/index.20130525160000606;done=true>>]
[junit4:junit4] 2> 1604248 T2953 C784 P44996 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3/index.20130525160000606
[junit4:junit4] 2> 1604248 T2953 C784 P44996 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty3/index.20130525160000606
[junit4:junit4] 2> 1604249 T2953 C784 P44996 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1604249 T2953 C784 P44996 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1604249 T2953 C784 P44996 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1604249 T2953 C784 P44996 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1604251 T2953 C784 P44996 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1604457 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1604458 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52286_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52286"}
[junit4:junit4] 2> 1604461 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:44996_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44996"}
[junit4:junit4] 2> 1604474 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1604474 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1604474 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1604474 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1604474 T2967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1604474 T2950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1604603 T2924 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1604603 T2924 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:52286_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 1604604 T2876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1605606 T2876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C783_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52286_, base_url=http://127.0.0.1:52286}
[junit4:junit4] 2> 1606605 T2970 C783 P52286 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:63497/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1606605 T2970 C783 P52286 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52286 START replicas=[http://127.0.0.1:63497/collection1/] nUpdates=100
[junit4:junit4] 2> 1606606 T2970 C783 P52286 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1606606 T2970 C783 P52286 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1606606 T2970 C783 P52286 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1606606 T2970 C783 P52286 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1606607 T2970 C783 P52286 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1606607 T2970 C783 P52286 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:63497/collection1/. core=collection1
[junit4:junit4] 2> 1606607 T2970 C783 P52286 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1606608 T2876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C786 name=collection1 org.apache.solr.core.SolrCore@286e9f81 url=http://127.0.0.1:63497/collection1 node=127.0.0.1:63497_ C786_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:63497_, base_url=http://127.0.0.1:63497, leader=true}
[junit4:junit4] 2> 1606616 T2925 C786 P63497 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1606620 T2926 C786 P63497 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1606623 T2926 C786 P63497 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f32a52f lockFactory=org.apache.lucene.store.NativeFSLockFactory@612c4ede)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1606624 T2926 C786 P63497 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1606625 T2926 C786 P63497 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f32a52f lockFactory=org.apache.lucene.store.NativeFSLockFactory@612c4ede)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f32a52f lockFactory=org.apache.lucene.store.NativeFSLockFactory@612c4ede)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1606625 T2926 C786 P63497 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1606626 T2926 C786 P63497 oass.SolrIndexSearcher.<init> Opening Searcher@47943625 realtime
[junit4:junit4] 2> 1606626 T2926 C786 P63497 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1606627 T2926 C786 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1606628 T2970 C783 P52286 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1606628 T2970 C783 P52286 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1606630 T2927 C786 P63497 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1606630 T2927 C786 P63497 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1606631 T2970 C783 P52286 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1606631 T2970 C783 P52286 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1606631 T2970 C783 P52286 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1606635 T2927 C786 P63497 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1606636 T2970 C783 P52286 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1606637 T2970 C783 P52286 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index.20130525160003003
[junit4:junit4] 2> 1606637 T2970 C783 P52286 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@b2d436d lockFactory=org.apache.lucene.store.NativeFSLockFactory@6a008b85; maxCacheMB=0.1767578125 maxMergeSizeMB=0.908203125)) fullCopy=false
[junit4:junit4] 2> 1606640 T2927 C786 P63497 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1606642 T2970 C783 P52286 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1606643 T2970 C783 P52286 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1606643 T2970 C783 P52286 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1606645 T2970 C783 P52286 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@18a6c51c lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b705848)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@18a6c51c lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b705848)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1606645 T2970 C783 P52286 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1606646 T2970 C783 P52286 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1606646 T2970 C783 P52286 oass.SolrIndexSearcher.<init> Opening Searcher@62497598 main
[junit4:junit4] 2> 1606647 T2969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@62497598 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1606648 T2970 C783 P52286 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index.20130525160003003 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index.20130525160003003;done=true>>]
[junit4:junit4] 2> 1606648 T2970 C783 P52286 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index.20130525160003003
[junit4:junit4] 2> 1606649 T2970 C783 P52286 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index.20130525160003003
[junit4:junit4] 2> 1606649 T2970 C783 P52286 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1606649 T2970 C783 P52286 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1606649 T2970 C783 P52286 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1606649 T2970 C783 P52286 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1606664 T2970 C783 P52286 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1607481 T2899 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1607482 T2899 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52286_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52286"}
[junit4:junit4] 2> 1607500 T2898 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1607500 T2950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1607500 T2918 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1607500 T2934 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1607500 T2905 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1607500 T2967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1607610 T2876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1607611 T2876 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C787 name=collection1 org.apache.solr.core.SolrCore@52371d56 url=http://127.0.0.1:63490/collection1 node=127.0.0.1:63490_ C787_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:63490_, base_url=http://127.0.0.1:63490, leader=true}
[junit4:junit4] 2> 1607618 T2888 C787 P63490 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1607621 T2888 C787 P63490 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5c75460f lockFactory=org.apache.lucene.store.NativeFSLockFactory@251017c7)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1607621 T2888 C787 P63490 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1607622 T2888 C787 P63490 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5c75460f lockFactory=org.apache.lucene.store.NativeFSLockFactory@251017c7)),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@5c75460f lockFactory=org.apache.lucene.store.NativeFSLockFactory@251017c7)),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1607622 T2888 C787 P63490 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1607623 T2888 C787 P63490 oass.SolrIndexSearcher.<init> Opening Searcher@1bf8baaf main
[junit4:junit4] 2> 1607623 T2888 C787 P63490 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1607624 T2902 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1bf8baaf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1607625 T2888 C787 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1607633 T2928 C786 P63497 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1607635 T2928 C786 P63497 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f32a52f lockFactory=org.apache.lucene.store.NativeFSLockFactory@612c4ede)),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2f32a52f lockFactory=org.apache.lucene.store.NativeFSLockFactory@612c4ede)),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1607635 T2928 C786 P63497 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1607635 T2928 C786 P63497 oass.SolrIndexSearcher.<init> Opening Searcher@5ae18b3c main
[junit4:junit4] 2> 1607636 T2928 C786 P63497 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1607636 T2936 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ae18b3c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1607637 T2928 C786 P63497 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:63494/collection1/, StdNode: http://127.0.0.1:44996/collection1/, StdNode: http://127.0.0.1:52286/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1607640 T2912 C785 P63494 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1607641 T2912 C785 P63494 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1110bbb1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4db60ec5)),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1110bbb1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4db60ec5)),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1607642 T2912 C785 P63494 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1607642 T2912 C785 P63494 oass.SolrIndexSearcher.<init> Opening Searcher@21049bd main
[junit4:junit4] 2> 1607643 T2912 C785 P63494 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1607643 T2920 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@21049bd main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1607644 T2912 C785 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> C784_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:44996_, base_url=http://127.0.0.1:44996}
[junit4:junit4] 2> 1607648 T2940 C784 P44996 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C783_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52286_, base_url=http://127.0.0.1:52286}
[junit4:junit4] 2> 1607648 T2957 C783 P52286 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1607649 T2940 C784 P44996 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@17ae5e4c lockFactory=org.apache.lucene.store.NativeFSLockFactory@3461c06a)),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@17ae5e4c lockFactory=org.apache.lucene.store.NativeFSLockFactory@3461c06a)),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1607650 T2957 C783 P52286 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@18a6c51c lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b705848)),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@18a6c51c lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b705848)),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1607650 T2940 C784 P44996 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1607650 T2957 C783 P52286 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1607651 T2940 C784 P44996 oass.SolrIndexSearcher.<init> Opening Searcher@734f2e86 main
[junit4:junit4] 2> 1607652 T2957 C783 P52286 oass.SolrIndexSearcher.<init> Opening Searcher@4a4b5165 main
[junit4:junit4] 2> 1607652 T2940 C784 P44996 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1607653 T2952 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@734f2e86 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1607652 T2957 C783 P52286 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1607653 T2940 C784 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 1607653 T2969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4a4b5165 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1607654 T2957 C783 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1607655 T2928 C786 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 1607656 T2876 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1607659 T2913 C785 P63494 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C788 name=collection1 org.apache.solr.core.SolrCore@10c70cdc url=http://127.0.0.1:44996/collection1 node=127.0.0.1:44996_ C788_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:44996_, base_url=http://127.0.0.1:44996}
[junit4:junit4] 2> 1607674 T2941 C788 P44996 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C789 name=collection1 org.apache.solr.core.SolrCore@286e9f81 url=http://127.0.0.1:63497/collection1 node=127.0.0.1:63497_ C789_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:63497_, base_url=http://127.0.0.1:63497, leader=true}
[junit4:junit4] 2> 1607676 T2929 C789 P63497 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C790 name=collection1 org.apache.solr.core.SolrCore@52a00007 url=http://127.0.0.1:52286/collection1 node=127.0.0.1:52286_ C790_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52286_, base_url=http://127.0.0.1:52286}
[junit4:junit4] 2> 1607678 T2958 C790 P52286 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C791 name=collection1 org.apache.solr.core.SolrCore@52371d56 url=http://127.0.0.1:63490/collection1 node=127.0.0.1:63490_ C791_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:63490_, base_url=http://127.0.0.1:63490, leader=true}
[junit4:junit4] 2> 1609684 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436048745876684800)} 0 2
[junit4:junit4] 2> 1609693 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1436048745881927680&update.from=http://127.0.0.1:63497/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436048745881927680)} 0 2
[junit4:junit4] 2> 1609697 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1436048745885073408&update.from=http://127.0.0.1:63494/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436048745885073408)} 0 2
[junit4:junit4] 2> ASYNC NEW_CORE C792 name=collection1 org.apache.solr.core.SolrCore@63c882b5 url=http://127.0.0.1:63494/collection1 node=127.0.0.1:63494_ C792_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:63494_, base_url=http://127.0.0.1:63494, leader=true}
[junit4:junit4] 2> 1609698 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1436048745885073408)} 0 7
[junit4:junit4] 2> 1609699 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436048745881927680)} 0 12
[junit4:junit4] 2> 1609702 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1436048745895559168)]} 0 1
[junit4:junit4] 2> 1609711 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1436048745901850624)]} 0 1
[junit4:junit4] 2> 1609711 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1436048745901850624)]} 0 4
[junit4:junit4] 2> 1609712 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0]} 0 8
[junit4:junit4] 2> 1609716 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1436048745910239232)]} 0 0
[junit4:junit4] 2> 1609720 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1436048745913384960)]} 0 0
[junit4:junit4] 2> 1609721 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1436048745913384960)]} 0 4
[junit4:junit4] 2> 1609724 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1436048745919676416)]} 0 0
[junit4:junit4] 2> 1609731 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1436048745922822144)]} 0 1
[junit4:junit4] 2> 1609732 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1436048745922822144)]} 0 5
[junit4:junit4] 2> 1609736 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1436048745931210752)]} 0 1
[junit4:junit4] 2> 1609745 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1436048745937502208)]} 0 1
[junit4:junit4] 2> 1609746 T2930 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1436048745937502208)]} 0 5
[junit4:junit4] 2> 1609746 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3]} 0 7
[junit4:junit4] 2> 1609750 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1436048745945890816)]} 0 1
[junit4:junit4] 2> 1609756 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1436048745949036544)]} 0 1
[junit4:junit4] 2> 1609756 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1436048745949036544)]} 0 4
[junit4:junit4] 2> 1609759 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1436048745956376576)]} 0 0
[junit4:junit4] 2> 1609765 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1436048745959522304)]} 0 0
[junit4:junit4] 2> 1609766 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1436048745959522304)]} 0 4
[junit4:junit4] 2> 1609769 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1436048745966862336)]} 0 0
[junit4:junit4] 2> 1609775 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1436048745970008064)]} 0 0
[junit4:junit4] 2> 1609776 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1436048745970008064)]} 0 4
[junit4:junit4] 2> 1609779 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1436048745977348096)]} 0 0
[junit4:junit4] 2> 1609785 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1436048745980493824)]} 0 0
[junit4:junit4] 2> 1609786 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1436048745980493824)]} 0 4
[junit4:junit4] 2> 1609790 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1436048745987833856)]} 0 1
[junit4:junit4] 2> 1609796 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1436048745992028160)]} 0 0
[junit4:junit4] 2> 1609797 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1436048745992028160)]} 0 4
[junit4:junit4] 2> 1609800 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1436048745999368192)]} 0 0
[junit4:junit4] 2> 1609806 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1436048746002513920)]} 0 0
[junit4:junit4] 2> 1609807 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1436048746002513920)]} 0 4
[junit4:junit4] 2> 1609811 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1436048746009853952)]} 0 1
[junit4:junit4] 2> 1609818 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1436048746015096832)]} 0 0
[junit4:junit4] 2> 1609819 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1436048746015096832)]} 0 4
[junit4:junit4] 2> 1609820 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10]} 0 7
[junit4:junit4] 2> 1609822 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1436048746022436864)]} 0 0
[junit4:junit4] 2> 1609828 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1436048746025582592)]} 0 0
[junit4:junit4] 2> 1609829 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1436048746025582592)]} 0 4
[junit4:junit4] 2> 1609832 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1436048746032922624)]} 0 0
[junit4:junit4] 2> 1609840 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1436048746038165504)]} 0 0
[junit4:junit4] 2> 1609841 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[12 (1436048746038165504)]} 0 4
[junit4:junit4] 2> 1609842 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12]} 0 7
[junit4:junit4] 2> 1609846 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1436048746046554112)]} 0 1
[junit4:junit4] 2> 1609854 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1436048746051796992)]} 0 1
[junit4:junit4] 2> 1609854 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[13 (1436048746051796992)]} 0 4
[junit4:junit4] 2> 1609855 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13]} 0 7
[junit4:junit4] 2> 1609858 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1436048746060185600)]} 0 0
[junit4:junit4] 2> 1609867 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1436048746065428480)]} 0 1
[junit4:junit4] 2> 1609867 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1436048746065428480)]} 0 4
[junit4:junit4] 2> 1609868 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14]} 0 7
[junit4:junit4] 2> 1609871 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1436048746073817088)]} 0 0
[junit4:junit4] 2> 1609879 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1436048746079059968)]} 0 0
[junit4:junit4] 2> 1609880 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[15 (1436048746079059968)]} 0 4
[junit4:junit4] 2> 1609881 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15]} 0 7
[junit4:junit4] 2> 1609883 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1436048746086400000)]} 0 0
[junit4:junit4] 2> 1609889 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1436048746089545728)]} 0 0
[junit4:junit4] 2> 1609890 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1436048746089545728)]} 0 4
[junit4:junit4] 2> 1609893 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1436048746096885760)]} 0 0
[junit4:junit4] 2> 1609899 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1436048746100031488)]} 0 0
[junit4:junit4] 2> 1609900 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1436048746100031488)]} 0 4
[junit4:junit4] 2> 1609903 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1436048746107371520)]} 0 0
[junit4:junit4] 2> 1609909 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1436048746110517248)]} 0 1
[junit4:junit4] 2> 1609910 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1436048746110517248)]} 0 4
[junit4:junit4] 2> 1609912 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1436048746116808704)]} 0 0
[junit4:junit4] 2> 1609920 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1436048746122051584)]} 0 0
[junit4:junit4] 2> 1609921 T2930 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[19 (1436048746122051584)]} 0 4
[junit4:junit4] 2> 1609922 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19]} 0 7
[junit4:junit4] 2> 1609925 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1436048746130440192)]} 0 0
[junit4:junit4] 2> 1609932 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1436048746133585920)]} 0 1
[junit4:junit4] 2> 1609932 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1436048746133585920)]} 0 4
[junit4:junit4] 2> 1609935 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1436048746140925952)]} 0 0
[junit4:junit4] 2> 1609943 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1436048746146168832)]} 0 0
[junit4:junit4] 2> 1609944 T2930 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[21 (1436048746146168832)]} 0 4
[junit4:junit4] 2> 1609945 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21]} 0 7
[junit4:junit4] 2> 1609948 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1436048746154557440)]} 0 0
[junit4:junit4] 2> 1609956 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1436048746159800320)]} 0 0
[junit4:junit4] 2> 1609957 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1436048746159800320)]} 0 4
[junit4:junit4] 2> 1609958 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22]} 0 7
[junit4:junit4] 2> 1609961 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1436048746168188928)]} 0 0
[junit4:junit4] 2> 1609967 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1436048746171334656)]} 0 0
[junit4:junit4] 2> 1609968 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1436048746171334656)]} 0 4
[junit4:junit4] 2> 1609971 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24 (1436048746178674688)]} 0 0
[junit4:junit4] 2> 1609979 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1436048746183917568)]} 0 0
[junit4:junit4] 2> 1609980 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[24 (1436048746183917568)]} 0 4
[junit4:junit4] 2> 1609981 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24]} 0 7
[junit4:junit4] 2> 1609984 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1436048746192306176)]} 0 0
[junit4:junit4] 2> 1609991 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1436048746195451904)]} 0 1
[junit4:junit4] 2> 1609992 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1436048746195451904)]} 0 5
[junit4:junit4] 2> 1609994 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26 (1436048746202791936)]} 0 0
[junit4:junit4] 2> 1610002 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1436048746208034816)]} 0 0
[junit4:junit4] 2> 1610003 T2930 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1436048746208034816)]} 0 4
[junit4:junit4] 2> 1610004 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26]} 0 7
[junit4:junit4] 2> 1610007 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27 (1436048746215374848)]} 0 1
[junit4:junit4] 2> 1610014 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1436048746220617728)]} 0 0
[junit4:junit4] 2> 1610015 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[27 (1436048746220617728)]} 0 4
[junit4:junit4] 2> 1610016 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27]} 0 7
[junit4:junit4] 2> 1610019 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28 (1436048746229006336)]} 0 0
[junit4:junit4] 2> 1610028 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1436048746234249216)]} 0 0
[junit4:junit4] 2> 1610028 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[28 (1436048746234249216)]} 0 4
[junit4:junit4] 2> 1610029 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28]} 0 7
[junit4:junit4] 2> 1610032 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1436048746242637824)]} 0 0
[junit4:junit4] 2> 1610040 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1436048746247880704)]} 0 0
[junit4:junit4] 2> 1610041 T2930 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[29 (1436048746247880704)]} 0 4
[junit4:junit4] 2> 1610042 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29]} 0 7
[junit4:junit4] 2> 1610044 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1436048746255220736)]} 0 0
[junit4:junit4] 2> 1610049 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1436048746258366464)]} 0 0
[junit4:junit4] 2> 1610050 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1436048746258366464)]} 0 3
[junit4:junit4] 2> 1610053 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1436048746264657920)]} 0 0
[junit4:junit4] 2> 1610059 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1436048746267803648)]} 0 0
[junit4:junit4] 2> 1610060 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1436048746267803648)]} 0 4
[junit4:junit4] 2> 1610064 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1436048746275143680)]} 0 1
[junit4:junit4] 2> 1610069 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1436048746278289408)]} 0 0
[junit4:junit4] 2> 1610070 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1436048746278289408)]} 0 4
[junit4:junit4] 2> 1610073 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1436048746285629440)]} 0 0
[junit4:junit4] 2> 1610079 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1436048746288775168)]} 0 0
[junit4:junit4] 2> 1610080 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1436048746288775168)]} 0 4
[junit4:junit4] 2> 1610084 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34 (1436048746296115200)]} 0 1
[junit4:junit4] 2> 1610092 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1436048746301358080)]} 0 1
[junit4:junit4] 2> 1610092 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[34 (1436048746301358080)]} 0 4
[junit4:junit4] 2> 1610093 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34]} 0 7
[junit4:junit4] 2> 1610096 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35 (1436048746309746688)]} 0 0
[junit4:junit4] 2> 1610102 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1436048746312892416)]} 0 0
[junit4:junit4] 2> 1610103 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35 (1436048746312892416)]} 0 4
[junit4:junit4] 2> 1610107 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36 (1436048746320232448)]} 0 1
[junit4:junit4] 2> 1610113 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1436048746325475328)]} 0 0
[junit4:junit4] 2> 1610114 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[36 (1436048746325475328)]} 0 3
[junit4:junit4] 2> 1610115 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36]} 0 6
[junit4:junit4] 2> 1610117 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37 (1436048746331766784)]} 0 0
[junit4:junit4] 2> 1610122 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1436048746334912512)]} 0 0
[junit4:junit4] 2> 1610123 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37 (1436048746334912512)]} 0 3
[junit4:junit4] 2> 1610127 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38 (1436048746341203968)]} 0 1
[junit4:junit4] 2> 1610134 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1436048746346446848)]} 0 0
[junit4:junit4] 2> 1610135 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[38 (1436048746346446848)]} 0 4
[junit4:junit4] 2> 1610136 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38]} 0 7
[junit4:junit4] 2> 1610139 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39 (1436048746354835456)]} 0 0
[junit4:junit4] 2> 1610145 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1436048746357981184)]} 0 0
[junit4:junit4] 2> 1610146 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39 (1436048746357981184)]} 0 4
[junit4:junit4] 2> 1610149 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1436048746365321216)]} 0 0
[junit4:junit4] 2> 1610154 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1436048746368466944)]} 0 0
[junit4:junit4] 2> 1610155 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1436048746368466944)]} 0 3
[junit4:junit4] 2> 1610159 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1436048746374758400)]} 0 1
[junit4:junit4] 2> 1610165 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1436048746378952704)]} 0 0
[junit4:junit4] 2> 1610166 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1436048746378952704)]} 0 4
[junit4:junit4] 2> 1610169 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1436048746386292736)]} 0 0
[junit4:junit4] 2> 1610174 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1436048746389438464)]} 0 0
[junit4:junit4] 2> 1610175 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1436048746389438464)]} 0 3
[junit4:junit4] 2> 1610178 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1436048746395729920)]} 0 0
[junit4:junit4] 2> 1610184 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1436048746398875648)]} 0 0
[junit4:junit4] 2> 1610185 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1436048746398875648)]} 0 4
[junit4:junit4] 2> 1610188 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1436048746406215680)]} 0 0
[junit4:junit4] 2> 1610194 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1436048746409361408)]} 0 0
[junit4:junit4] 2> 1610195 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1436048746409361408)]} 0 4
[junit4:junit4] 2> 1610198 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45 (1436048746416701440)]} 0 0
[junit4:junit4] 2> 1610204 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1436048746419847168)]} 0 0
[junit4:junit4] 2> 1610205 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45 (1436048746419847168)]} 0 4
[junit4:junit4] 2> 1610208 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46 (1436048746427187200)]} 0 0
[junit4:junit4] 2> 1610214 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1436048746430332928)]} 0 0
[junit4:junit4] 2> 1610215 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46 (1436048746430332928)]} 0 4
[junit4:junit4] 2> 1610219 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47 (1436048746437672960)]} 0 1
[junit4:junit4] 2> 1610226 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1436048746442915840)]} 0 0
[junit4:junit4] 2> 1610227 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[47 (1436048746442915840)]} 0 4
[junit4:junit4] 2> 1610228 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47]} 0 7
[junit4:junit4] 2> 1610231 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48 (1436048746450255872)]} 0 0
[junit4:junit4] 2> 1610238 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1436048746455498752)]} 0 0
[junit4:junit4] 2> 1610239 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[48 (1436048746455498752)]} 0 4
[junit4:junit4] 2> 1610240 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48]} 0 7
[junit4:junit4] 2> 1610243 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49 (1436048746462838784)]} 0 1
[junit4:junit4] 2> 1610249 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1436048746465984512)]} 0 1
[junit4:junit4] 2> 1610249 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49 (1436048746465984512)]} 0 4
[junit4:junit4] 2> 1610252 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1436048746473324544)]} 0 0
[junit4:junit4] 2> 1610258 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1436048746476470272)]} 0 0
[junit4:junit4] 2> 1610259 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1436048746476470272)]} 0 4
[junit4:junit4] 2> 1610262 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51 (1436048746483810304)]} 0 0
[junit4:junit4] 2> 1610267 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1436048746486956032)]} 0 0
[junit4:junit4] 2> 1610268 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51 (1436048746486956032)]} 0 3
[junit4:junit4] 2> 1610271 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52 (1436048746493247488)]} 0 0
[junit4:junit4] 2> 1610279 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1436048746498490368)]} 0 0
[junit4:junit4] 2> 1610280 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[52 (1436048746498490368)]} 0 4
[junit4:junit4] 2> 1610281 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52]} 0 7
[junit4:junit4] 2> 1610284 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53 (1436048746506878976)]} 0 0
[junit4:junit4] 2> 1610292 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1436048746512121856)]} 0 0
[junit4:junit4] 2> 1610293 T2930 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1436048746512121856)]} 0 4
[junit4:junit4] 2> 1610294 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53]} 0 7
[junit4:junit4] 2> 1610296 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54 (1436048746519461888)]} 0 0
[junit4:junit4] 2> 1610305 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1436048746524704768)]} 0 1
[junit4:junit4] 2> 1610305 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[54 (1436048746524704768)]} 0 4
[junit4:junit4] 2> 1610306 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54]} 0 7
[junit4:junit4] 2> 1610309 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55 (1436048746533093376)]} 0 0
[junit4:junit4] 2> 1610317 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1436048746538336256)]} 0 0
[junit4:junit4] 2> 1610318 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[55 (1436048746538336256)]} 0 4
[junit4:junit4] 2> 1610319 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55]} 0 7
[junit4:junit4] 2> 1610322 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1436048746546724864)]} 0 0
[junit4:junit4] 2> 1610328 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1436048746549870592)]} 0 0
[junit4:junit4] 2> 1610329 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1436048746549870592)]} 0 4
[junit4:junit4] 2> 1610332 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57 (1436048746557210624)]} 0 0
[junit4:junit4] 2> 1610339 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1436048746560356352)]} 0 1
[junit4:junit4] 2> 1610340 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57 (1436048746560356352)]} 0 5
[junit4:junit4] 2> 1610342 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58 (1436048746567696384)]} 0 0
[junit4:junit4] 2> 1610349 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1436048746570842112)]} 0 1
[junit4:junit4] 2> 1610349 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58 (1436048746570842112)]} 0 4
[junit4:junit4] 2> 1610352 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59 (1436048746578182144)]} 0 0
[junit4:junit4] 2> 1610361 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1436048746583425024)]} 0 1
[junit4:junit4] 2> 1610361 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[59 (1436048746583425024)]} 0 4
[junit4:junit4] 2> 1610362 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59]} 0 7
[junit4:junit4] 2> 1610365 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60 (1436048746591813632)]} 0 0
[junit4:junit4] 2> 1610373 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1436048746597056512)]} 0 0
[junit4:junit4] 2> 1610374 T2930 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[60 (1436048746597056512)]} 0 4
[junit4:junit4] 2> 1610375 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60]} 0 7
[junit4:junit4] 2> 1610377 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61 (1436048746604396544)]} 0 0
[junit4:junit4] 2> 1610382 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1436048746607542272)]} 0 0
[junit4:junit4] 2> 1610383 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61 (1436048746607542272)]} 0 3
[junit4:junit4] 2> 1610386 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62 (1436048746613833728)]} 0 0
[junit4:junit4] 2> 1610392 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1436048746616979456)]} 0 0
[junit4:junit4] 2> 1610393 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62 (1436048746616979456)]} 0 4
[junit4:junit4] 2> 1610396 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63 (1436048746624319488)]} 0 0
[junit4:junit4] 2> 1610402 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1436048746627465216)]} 0 0
[junit4:junit4] 2> 1610403 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63 (1436048746627465216)]} 0 4
[junit4:junit4] 2> 1610406 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64 (1436048746634805248)]} 0 0
[junit4:junit4] 2> 1610414 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1436048746640048128)]} 0 0
[junit4:junit4] 2> 1610415 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[64 (1436048746640048128)]} 0 4
[junit4:junit4] 2> 1610416 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64]} 0 7
[junit4:junit4] 2> 1610418 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65 (1436048746647388160)]} 0 0
[junit4:junit4] 2> 1610424 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[65 (1436048746650533888)]} 0 0
[junit4:junit4] 2> 1610425 T2914 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65 (1436048746650533888)]} 0 4
[junit4:junit4] 2> 1610428 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66 (1436048746657873920)]} 0 0
[junit4:junit4] 2> 1610437 T2942 C788 P44996 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63494/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[66 (1436048746664165376)]} 0 0
[junit4:junit4] 2> 1610438 T2912 C792 P63494 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[66 (1436048746664165376)]} 0 4
[junit4:junit4] 2> 1610439 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66]} 0 8
[junit4:junit4] 2> 1610442 T2888 C791 P63490 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[67 (1436048746671505408)]} 0 1
[junit4:junit4] 2> 1610448 T2957 C790 P52286 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:63497/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[67 (1436048746675699712)]} 0 0
[junit4:junit4] 2> 1610449 T2928 C789 P63497 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[67 (143604874
[...truncated too long message...]
=collection1 url=http://127.0.0.1:52286 couldn't connect to http://127.0.0.1:63497/collection1/, counting as success
[junit4:junit4] 2> 1843297 T2967 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52286 DONE. sync succeeded
[junit4:junit4] 2> 1843297 T2967 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1843299 T2967 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4] 2> 1843299 T2967 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52286/collection1/
[junit4:junit4] 2> 1843299 T2967 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@52a00007
[junit4:junit4] 2> 1843300 T2967 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=642,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1843300 T2967 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1843300 T2967 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1843301 T2967 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1843303 T2967 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1843303 T2967 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1843304 T2967 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index;done=false>>]
[junit4:junit4] 2> 1843304 T2967 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4/index
[junit4:junit4] 2> 1843304 T2967 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4;done=false>>]
[junit4:junit4] 2> 1843304 T2967 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369522780135/jetty4
[junit4:junit4] 2> 1843304 T2967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1843305 T2967 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89753044919386124-5-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1843305 T2967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1843305 T2967 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1843306 T2967 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1843306 T2967 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1843306 T2967 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1843306 T2967 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=200), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=200)), sim=DefaultSimilarity, locale=ja_JP_JP_#u-ca-japanese, timezone=America/Dawson
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=3,free=113330560,total=244318208
[junit4:junit4] 2> NOTE: All tests run in this JVM: [ChaosMonkeyNothingIsSafeTest, SyncSliceTest, LukeRequestHandlerTest, PluginInfoTest, FileBasedSpellCheckerTest, TestLMDirichletSimilarityFactory, ZkControllerTest, SliceStateTest, TestCharFilters, TestSolrDeletionPolicy1, TestPHPSerializedResponseWriter, TestSolrDeletionPolicy2, TestReversedWildcardFilterFactory, SOLR749Test, QueryResultKeyTest, TestSearchPerf, BadCopyFieldTest, TestTrie, DirectSolrConnectionTest, TestPerFieldSimilarity, LoggingHandlerTest, AutoCommitTest, TestFuzzyAnalyzedSuggestions, BinaryUpdateRequestHandlerTest, StatelessScriptUpdateProcessorFactoryTest, BasicDistributedZkTest, TestLRUCache, TestWriterPerf, PrimUtilsTest, TestGroupingSearch, TestPluginEnable, TestCloudManagedSchemaAddField, TermsComponentTest, IndexSchemaTest, TestQueryUtils, TestLFUCache, UUIDFieldTest, ShowFileRequestHandlerTest, AlternateDirectoryTest, TestFunctionQuery, TestCloudManagedSchema, TestJoin, PolyFieldTest, TestSort, OverseerTest, SystemInfoHandlerTest, TestReplicationHandler, TestClassNameShortening, MBeansHandlerTest, SearchHandlerTest, TestFastLRUCache, ReturnFieldsTest, DocValuesTest, TestFieldCollectionResource, DistributedTermsComponentTest, TestSolrCoreProperties, ZkCLITest, SolrInfoMBeanTest, LeaderElectionTest, TestQuerySenderListener, UpdateRequestProcessorFactoryTest, TestSolrQueryParser, TestFaceting, SliceStateUpdateTest, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 260.14s, 1 test, 1 error <<< FAILURES!
[...truncated 406 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:380: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:360: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 error, 13 ignored (7 assumptions)
Total time: 56 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4016 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4016/
1 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:51277 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:51277 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([697FBA05C4012ED7:E899341DB35E4EEB]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9407 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 420764 T1409 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 420771 T1409 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-ShardSplitTest-1369485132732
[junit4:junit4] 2> 420773 T1409 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 420773 T1410 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 420874 T1409 oasc.ZkTestServer.run start zk server on port:51270
[junit4:junit4] 2> 420875 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 420879 T1416 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66b0f85e name:ZooKeeperConnection Watcher:127.0.0.1:51270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 420879 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 420880 T1409 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 420895 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 420897 T1418 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fe88a78 name:ZooKeeperConnection Watcher:127.0.0.1:51270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 420898 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 420898 T1409 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 420904 T1409 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 420907 T1409 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 420916 T1409 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 420920 T1409 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 420921 T1409 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 420935 T1409 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 420936 T1409 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 421040 T1409 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 421041 T1409 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 421052 T1409 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 421053 T1409 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 421057 T1409 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 421058 T1409 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 421062 T1409 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 421063 T1409 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 421067 T1409 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 421067 T1409 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 421071 T1409 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 421072 T1409 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 421076 T1409 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 421077 T1409 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 421338 T1409 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 421342 T1409 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51273
[junit4:junit4] 2> 421343 T1409 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 421343 T1409 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 421344 T1409 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369485133042
[junit4:junit4] 2> 421344 T1409 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369485133042/solr.xml
[junit4:junit4] 2> 421345 T1409 oasc.CoreContainer.<init> New CoreContainer 1364380436
[junit4:junit4] 2> 421346 T1409 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369485133042/'
[junit4:junit4] 2> 421346 T1409 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369485133042/'
[junit4:junit4] 2> 421472 T1409 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 421472 T1409 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 421473 T1409 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 421474 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 421474 T1409 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 421475 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 421475 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 421476 T1409 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 421476 T1409 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 421477 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 421493 T1409 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 421493 T1409 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51270/solr
[junit4:junit4] 2> 421494 T1409 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 421495 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 421498 T1429 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1be34f name:ZooKeeperConnection Watcher:127.0.0.1:51270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 421499 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 421502 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 421513 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 421515 T1431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72c8baa3 name:ZooKeeperConnection Watcher:127.0.0.1:51270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 421515 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 421518 T1409 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 421528 T1409 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 421533 T1409 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 421535 T1409 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51273_
[junit4:junit4] 2> 421543 T1409 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51273_
[junit4:junit4] 2> 421547 T1409 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 421560 T1409 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 421569 T1409 oasc.Overseer.start Overseer (id=89750577659248643-127.0.0.1:51273_-n_0000000000) starting
[junit4:junit4] 2> 421578 T1409 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 421590 T1433 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 421591 T1409 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 421595 T1409 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 421597 T1409 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 421601 T1432 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 421605 T1434 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369485133042/collection1
[junit4:junit4] 2> 421605 T1434 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 421606 T1434 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 421607 T1434 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 421609 T1434 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369485133042/collection1/'
[junit4:junit4] 2> 421610 T1434 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369485133042/collection1/lib/README' to classloader
[junit4:junit4] 2> 421611 T1434 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369485133042/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 421661 T1434 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 421721 T1434 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 421822 T1434 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 421831 T1434 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 422410 T1434 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 422414 T1434 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 422417 T1434 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 422422 T1434 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 422454 T1434 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 422455 T1434 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369485133042/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369485132732/control/data/
[junit4:junit4] 2> 422455 T1434 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fafcae2
[junit4:junit4] 2> 422456 T1434 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 422456 T1434 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/control/data
[junit4:junit4] 2> 422457 T1434 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369485132732/control/data/index/
[junit4:junit4] 2> 422457 T1434 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369485132732/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 422458 T1434 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/control/data/index
[junit4:junit4] 2> 422462 T1434 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c46649d lockFactory=org.apache.lucene.store.NativeFSLockFactory@7922042e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 422463 T1434 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 422466 T1434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 422466 T1434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 422467 T1434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 422467 T1434 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 422468 T1434 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 422468 T1434 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 422469 T1434 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 422469 T1434 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 422470 T1434 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 422486 T1434 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 422493 T1434 oass.SolrIndexSearcher.<init> Opening Searcher@55f8f897 main
[junit4:junit4] 2> 422494 T1434 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369485132732/control/data/tlog
[junit4:junit4] 2> 422495 T1434 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 422495 T1434 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 422499 T1435 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@55f8f897 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 422501 T1434 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 422502 T1434 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 423106 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 423107 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51273_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51273"}
[junit4:junit4] 2> 423107 T1432 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 423107 T1432 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 423146 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 423508 T1434 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 423508 T1434 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51273 collection:control_collection shard:shard1
[junit4:junit4] 2> 423509 T1434 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 423527 T1434 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 423538 T1434 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 423539 T1434 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 423539 T1434 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51273/collection1/
[junit4:junit4] 2> 423539 T1434 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 423539 T1434 oasc.SyncStrategy.syncToMe http://127.0.0.1:51273/collection1/ has no replicas
[junit4:junit4] 2> 423540 T1434 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51273/collection1/
[junit4:junit4] 2> 423540 T1434 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 424652 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 424676 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 424721 T1434 oasc.ZkController.register We are http://127.0.0.1:51273/collection1/ and leader is http://127.0.0.1:51273/collection1/
[junit4:junit4] 2> 424721 T1434 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51273
[junit4:junit4] 2> 424721 T1434 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 424721 T1434 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 424722 T1434 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 424724 T1434 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 424725 T1409 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 424726 T1409 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 424726 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 424742 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 424744 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 424746 T1438 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21ee41cb name:ZooKeeperConnection Watcher:127.0.0.1:51270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 424747 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 424749 T1409 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 424752 T1409 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 425015 T1409 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 425018 T1409 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51277
[junit4:junit4] 2> 425019 T1409 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 425020 T1409 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 425020 T1409 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369485136713
[junit4:junit4] 2> 425021 T1409 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369485136713/solr.xml
[junit4:junit4] 2> 425021 T1409 oasc.CoreContainer.<init> New CoreContainer 627435437
[junit4:junit4] 2> 425022 T1409 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369485136713/'
[junit4:junit4] 2> 425022 T1409 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369485136713/'
[junit4:junit4] 2> 425148 T1409 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 425149 T1409 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 425149 T1409 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 425150 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 425150 T1409 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 425151 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 425151 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 425152 T1409 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 425152 T1409 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 425153 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 425168 T1409 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 425169 T1409 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51270/solr
[junit4:junit4] 2> 425170 T1409 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 425171 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 425174 T1449 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55cc5e7d name:ZooKeeperConnection Watcher:127.0.0.1:51270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 425175 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 425191 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 425202 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 425205 T1451 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1243b1aa name:ZooKeeperConnection Watcher:127.0.0.1:51270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 425205 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 425216 T1409 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 426183 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 426184 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51273__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51273_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51273"}
[junit4:junit4] 2> 426199 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 426199 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 426199 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 426220 T1409 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51277_
[junit4:junit4] 2> 426222 T1409 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51277_
[junit4:junit4] 2> 426225 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 426225 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 426226 T1438 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 426226 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 426227 T1431 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 426227 T1451 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 426239 T1452 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369485136713/collection1
[junit4:junit4] 2> 426239 T1452 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 426240 T1452 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 426240 T1452 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 426242 T1452 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369485136713/collection1/'
[junit4:junit4] 2> 426243 T1452 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369485136713/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 426244 T1452 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369485136713/collection1/lib/README' to classloader
[junit4:junit4] 2> 426294 T1452 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 426354 T1452 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 426455 T1452 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 426462 T1452 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 427032 T1452 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 427036 T1452 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 427038 T1452 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 427044 T1452 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 427073 T1452 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 427074 T1452 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369485136713/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty1/
[junit4:junit4] 2> 427074 T1452 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fafcae2
[junit4:junit4] 2> 427075 T1452 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 427075 T1452 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty1
[junit4:junit4] 2> 427076 T1452 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty1/index/
[junit4:junit4] 2> 427076 T1452 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 427077 T1452 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty1/index
[junit4:junit4] 2> 427080 T1452 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@66353ae1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2abfab01),segFN=segments_1,generation=1}
[junit4:junit4] 2> 427081 T1452 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 427084 T1452 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 427085 T1452 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 427085 T1452 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 427086 T1452 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 427087 T1452 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 427087 T1452 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 427087 T1452 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 427088 T1452 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 427089 T1452 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 427105 T1452 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 427112 T1452 oass.SolrIndexSearcher.<init> Opening Searcher@6ee46c1c main
[junit4:junit4] 2> 427113 T1452 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty1/tlog
[junit4:junit4] 2> 427114 T1452 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 427114 T1452 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 427119 T1453 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6ee46c1c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 427122 T1452 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 427122 T1452 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 427706 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 427707 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51277_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51277"}
[junit4:junit4] 2> 427708 T1432 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 427708 T1432 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 427726 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 427726 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 427726 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 428146 T1452 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 428146 T1452 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51277 collection:collection1 shard:shard1
[junit4:junit4] 2> 428147 T1452 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 428168 T1452 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 428177 T1452 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 428178 T1452 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 428178 T1452 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51277/collection1/
[junit4:junit4] 2> 428178 T1452 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 428178 T1452 oasc.SyncStrategy.syncToMe http://127.0.0.1:51277/collection1/ has no replicas
[junit4:junit4] 2> 428179 T1452 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51277/collection1/
[junit4:junit4] 2> 428179 T1452 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 429232 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 429254 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 429254 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 429254 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 429265 T1452 oasc.ZkController.register We are http://127.0.0.1:51277/collection1/ and leader is http://127.0.0.1:51277/collection1/
[junit4:junit4] 2> 429265 T1452 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51277
[junit4:junit4] 2> 429265 T1452 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 429265 T1452 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 429266 T1452 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 429268 T1452 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 429269 T1409 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 429269 T1409 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 429270 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 429552 T1409 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 429556 T1409 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51280
[junit4:junit4] 2> 429556 T1409 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 429557 T1409 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 429557 T1409 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369485141246
[junit4:junit4] 2> 429558 T1409 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369485141246/solr.xml
[junit4:junit4] 2> 429558 T1409 oasc.CoreContainer.<init> New CoreContainer 1028510364
[junit4:junit4] 2> 429559 T1409 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369485141246/'
[junit4:junit4] 2> 429560 T1409 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369485141246/'
[junit4:junit4] 2> 429688 T1409 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 429689 T1409 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 429689 T1409 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 429690 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 429690 T1409 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 429691 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 429691 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 429692 T1409 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 429692 T1409 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 429693 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 429710 T1409 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 429711 T1409 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51270/solr
[junit4:junit4] 2> 429711 T1409 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 429713 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 429716 T1465 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f89ec05 name:ZooKeeperConnection Watcher:127.0.0.1:51270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 429716 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 429733 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 429746 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 429748 T1467 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b0b8cfd name:ZooKeeperConnection Watcher:127.0.0.1:51270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 429748 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 429759 T1409 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 430761 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 430762 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51277__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51277_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51277"}
[junit4:junit4] 2> 430763 T1409 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51280_
[junit4:junit4] 2> 430765 T1409 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51280_
[junit4:junit4] 2> 430786 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 430786 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 430792 T1467 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 430793 T1438 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 430793 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430793 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430794 T1451 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 430794 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430796 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430798 T1431 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 430798 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430801 T1468 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369485141246/collection1
[junit4:junit4] 2> 430802 T1468 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 430802 T1468 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 430803 T1468 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 430805 T1468 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369485141246/collection1/'
[junit4:junit4] 2> 430806 T1468 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369485141246/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 430807 T1468 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369485141246/collection1/lib/README' to classloader
[junit4:junit4] 2> 430857 T1468 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 430917 T1468 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 431018 T1468 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 431025 T1468 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 431592 T1468 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 431596 T1468 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 431598 T1468 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 431604 T1468 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 431634 T1468 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 431634 T1468 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369485141246/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty2/
[junit4:junit4] 2> 431635 T1468 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fafcae2
[junit4:junit4] 2> 431635 T1468 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 431636 T1468 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty2
[junit4:junit4] 2> 431637 T1468 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty2/index/
[junit4:junit4] 2> 431637 T1468 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 431638 T1468 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty2/index
[junit4:junit4] 2> 431642 T1468 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64cffe20 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28189138),segFN=segments_1,generation=1}
[junit4:junit4] 2> 431642 T1468 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 431645 T1468 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 431646 T1468 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 431646 T1468 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 431647 T1468 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 431648 T1468 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 431648 T1468 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 431649 T1468 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 431649 T1468 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 431650 T1468 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 431666 T1468 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 431673 T1468 oass.SolrIndexSearcher.<init> Opening Searcher@603392e0 main
[junit4:junit4] 2> 431674 T1468 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty2/tlog
[junit4:junit4] 2> 431675 T1468 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 431675 T1468 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 431681 T1469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@603392e0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 431683 T1468 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 431683 T1468 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 432299 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 432301 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51280_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51280"}
[junit4:junit4] 2> 432301 T1432 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 432301 T1432 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 432316 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 432316 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 432316 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 432316 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 432687 T1468 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 432687 T1468 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51280 collection:collection1 shard:shard2
[junit4:junit4] 2> 432688 T1468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 432710 T1468 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 432721 T1468 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 432722 T1468 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 432722 T1468 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51280/collection1/
[junit4:junit4] 2> 432722 T1468 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 432722 T1468 oasc.SyncStrategy.syncToMe http://127.0.0.1:51280/collection1/ has no replicas
[junit4:junit4] 2> 432723 T1468 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51280/collection1/
[junit4:junit4] 2> 432723 T1468 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 433832 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 433853 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 433853 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 433853 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 433853 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 433903 T1468 oasc.ZkController.register We are http://127.0.0.1:51280/collection1/ and leader is http://127.0.0.1:51280/collection1/
[junit4:junit4] 2> 433903 T1468 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51280
[junit4:junit4] 2> 433903 T1468 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 433903 T1468 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 433904 T1468 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 433906 T1468 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 433907 T1409 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 433908 T1409 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 433908 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 434182 T1409 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 434186 T1409 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51283
[junit4:junit4] 2> 434187 T1409 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 434187 T1409 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 434188 T1409 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369485145884
[junit4:junit4] 2> 434188 T1409 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369485145884/solr.xml
[junit4:junit4] 2> 434189 T1409 oasc.CoreContainer.<init> New CoreContainer 233898913
[junit4:junit4] 2> 434189 T1409 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369485145884/'
[junit4:junit4] 2> 434190 T1409 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369485145884/'
[junit4:junit4] 2> 434316 T1409 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 434316 T1409 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 434317 T1409 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 434317 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 434318 T1409 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 434318 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 434319 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 434319 T1409 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 434320 T1409 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 434320 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 434336 T1409 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 434337 T1409 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51270/solr
[junit4:junit4] 2> 434337 T1409 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 434338 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 434342 T1481 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5dbe3ad9 name:ZooKeeperConnection Watcher:127.0.0.1:51270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 434342 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 434356 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 434366 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 434369 T1483 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ad3cf22 name:ZooKeeperConnection Watcher:127.0.0.1:51270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 434369 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 434380 T1409 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 435367 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 435368 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51280__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51280_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51280"}
[junit4:junit4] 2> 435385 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 435385 T1409 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51283_
[junit4:junit4] 2> 435385 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 435385 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 435385 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 435385 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 435388 T1409 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51283_
[junit4:junit4] 2> 435397 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 435397 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 435398 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 435398 T1483 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 435398 T1438 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 435399 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 435399 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 435400 T1467 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 435400 T1451 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 435401 T1431 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 435407 T1484 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369485145884/collection1
[junit4:junit4] 2> 435407 T1484 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 435408 T1484 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 435408 T1484 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 435410 T1484 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369485145884/collection1/'
[junit4:junit4] 2> 435412 T1484 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369485145884/collection1/lib/README' to classloader
[junit4:junit4] 2> 435412 T1484 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369485145884/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 435463 T1484 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 435523 T1484 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 435624 T1484 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 435631 T1484 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 436245 T1484 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 436249 T1484 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 436251 T1484 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 436257 T1484 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 436287 T1484 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 436287 T1484 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369485145884/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/
[junit4:junit4] 2> 436288 T1484 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fafcae2
[junit4:junit4] 2> 436288 T1484 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 436289 T1484 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3
[junit4:junit4] 2> 436289 T1484 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index/
[junit4:junit4] 2> 436290 T1484 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 436290 T1484 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index
[junit4:junit4] 2> 436294 T1484 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e166dbe lockFactory=org.apache.lucene.store.NativeFSLockFactory@68bf7916),segFN=segments_1,generation=1}
[junit4:junit4] 2> 436295 T1484 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 436298 T1484 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 436298 T1484 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 436299 T1484 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 436300 T1484 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 436301 T1484 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 436301 T1484 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 436301 T1484 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 436302 T1484 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 436303 T1484 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 436319 T1484 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 436327 T1484 oass.SolrIndexSearcher.<init> Opening Searcher@5b66f726 main
[junit4:junit4] 2> 436327 T1484 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/tlog
[junit4:junit4] 2> 436328 T1484 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 436329 T1484 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 436333 T1485 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5b66f726 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 436336 T1484 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 436336 T1484 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 436899 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 436901 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51283_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51283"}
[junit4:junit4] 2> 436901 T1432 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 436901 T1432 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 436967 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 436967 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 436967 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 436967 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 436967 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 437339 T1484 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 437339 T1484 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51283 collection:collection1 shard:shard1
[junit4:junit4] 2> 437364 T1484 oasc.ZkController.register We are http://127.0.0.1:51283/collection1/ and leader is http://127.0.0.1:51277/collection1/
[junit4:junit4] 2> 437364 T1484 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51283
[junit4:junit4] 2> 437364 T1484 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 437365 T1484 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C413 name=collection1 org.apache.solr.core.SolrCore@1a44c68a url=http://127.0.0.1:51283/collection1 node=127.0.0.1:51283_ C413_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:51283_, base_url=http://127.0.0.1:51283}
[junit4:junit4] 2> 437365 T1486 C413 P51283 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 437366 T1486 C413 P51283 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 437366 T1484 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 437366 T1486 C413 P51283 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 437367 T1486 C413 P51283 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 437367 T1409 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 437368 T1409 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 437368 T1486 C413 P51283 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 437368 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 437382 T1441 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:51283__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 437560 T1409 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 437562 T1409 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51287
[junit4:junit4] 2> 437563 T1409 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 437563 T1409 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 437564 T1409 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369485149340
[junit4:junit4] 2> 437564 T1409 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369485149340/solr.xml
[junit4:junit4] 2> 437564 T1409 oasc.CoreContainer.<init> New CoreContainer 128024196
[junit4:junit4] 2> 437565 T1409 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369485149340/'
[junit4:junit4] 2> 437565 T1409 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369485149340/'
[junit4:junit4] 2> 437657 T1409 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 437658 T1409 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 437658 T1409 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 437658 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 437659 T1409 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 437659 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 437659 T1409 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 437660 T1409 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 437660 T1409 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 437660 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 437671 T1409 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 437672 T1409 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51270/solr
[junit4:junit4] 2> 437672 T1409 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 437673 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 437681 T1498 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b6a40cb name:ZooKeeperConnection Watcher:127.0.0.1:51270 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 437682 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 437704 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 437716 T1409 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 437718 T1500 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b2e83f1 name:ZooKeeperConnection Watcher:127.0.0.1:51270/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 437719 T1409 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 437725 T1409 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 438473 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 438474 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51283__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51283_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51283"}
[junit4:junit4] 2> 438516 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 438516 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 438516 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 438516 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 438516 T1500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 438516 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 438729 T1409 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51287_
[junit4:junit4] 2> 438756 T1409 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51287_
[junit4:junit4] 2> 438759 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 438759 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 438760 T1438 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 438759 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 438760 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 438760 T1500 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 438760 T1483 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 438761 T1500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 438761 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 438761 T1467 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 438762 T1451 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 438763 T1431 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 438769 T1501 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369485149340/collection1
[junit4:junit4] 2> 438769 T1501 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 438770 T1501 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 438770 T1501 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 438771 T1501 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369485149340/collection1/'
[junit4:junit4] 2> 438773 T1501 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369485149340/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 438773 T1501 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369485149340/collection1/lib/README' to classloader
[junit4:junit4] 2> 438815 T1501 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 438881 T1501 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 438983 T1501 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 438990 T1501 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 439384 T1441 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:51283__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 439384 T1441 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:51283__collection1&state=recovering&nodeName=127.0.0.1:51283_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 439616 T1501 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 439620 T1501 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 439622 T1501 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 439628 T1501 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 439658 T1501 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 439658 T1501 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369485149340/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4/
[junit4:junit4] 2> 439659 T1501 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fafcae2
[junit4:junit4] 2> 439659 T1501 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 439660 T1501 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4
[junit4:junit4] 2> 439660 T1501 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4/index/
[junit4:junit4] 2> 439661 T1501 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 439661 T1501 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4/index
[junit4:junit4] 2> 439665 T1501 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e97cf8f lockFactory=org.apache.lucene.store.NativeFSLockFactory@10ec9245),segFN=segments_1,generation=1}
[junit4:junit4] 2> 439666 T1501 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 439669 T1501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 439670 T1501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 439670 T1501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 439671 T1501 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 439672 T1501 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 439672 T1501 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 439673 T1501 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 439673 T1501 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 439674 T1501 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 439693 T1501 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 439700 T1501 oass.SolrIndexSearcher.<init> Opening Searcher@34b64eaa main
[junit4:junit4] 2> 439701 T1501 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4/tlog
[junit4:junit4] 2> 439702 T1501 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 439702 T1501 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 439708 T1502 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@34b64eaa main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 439710 T1501 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 439711 T1501 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 440022 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 440023 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51287_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51287"}
[junit4:junit4] 2> 440024 T1432 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 440024 T1432 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 440036 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440036 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440036 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440036 T1500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440036 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440036 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440714 T1501 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 440714 T1501 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51287 collection:collection1 shard:shard2
[junit4:junit4] 2> 440747 T1501 oasc.ZkController.register We are http://127.0.0.1:51287/collection1/ and leader is http://127.0.0.1:51280/collection1/
[junit4:junit4] 2> 440747 T1501 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51287
[junit4:junit4] 2> 440747 T1501 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 440747 T1501 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C414 name=collection1 org.apache.solr.core.SolrCore@40164efd url=http://127.0.0.1:51287/collection1 node=127.0.0.1:51287_ C414_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:51287_, base_url=http://127.0.0.1:51287}
[junit4:junit4] 2> 440748 T1503 C414 P51287 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 440749 T1503 C414 P51287 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 440749 T1501 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 440749 T1503 C414 P51287 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 440749 T1503 C414 P51287 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 440750 T1409 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 440751 T1409 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 440751 T1503 C414 P51287 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 440751 T1409 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 440774 T1409 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 440775 T1457 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:51287__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 440776 T1409 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 440776 T1409 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 440777 T1409 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C415 name=collection1 org.apache.solr.core.SolrCore@1a44c68a url=http://127.0.0.1:51283/collection1 node=127.0.0.1:51283_ C415_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51283_, base_url=http://127.0.0.1:51283}
[junit4:junit4] 2> 441386 T1486 C415 P51283 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51277/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 441386 T1486 C415 P51283 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51283 START replicas=[http://127.0.0.1:51277/collection1/] nUpdates=100
[junit4:junit4] 2> 441387 T1486 C415 P51283 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 441387 T1486 C415 P51283 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 441388 T1486 C415 P51283 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 441388 T1486 C415 P51283 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 441388 T1486 C415 P51283 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 441389 T1486 C415 P51283 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51277/collection1/. core=collection1
[junit4:junit4] 2> 441389 T1486 C415 P51283 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C416 name=collection1 org.apache.solr.core.SolrCore@3874aade url=http://127.0.0.1:51277/collection1 node=127.0.0.1:51277_ C416_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51277_, base_url=http://127.0.0.1:51277, leader=true}
[junit4:junit4] 2> 441397 T1442 C416 P51277 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 441403 T1443 C416 P51277 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 441406 T1443 C416 P51277 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@66353ae1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2abfab01),segFN=segments_1,generation=1}
[junit4:junit4] 2> 441407 T1443 C416 P51277 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 441408 T1443 C416 P51277 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@66353ae1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2abfab01),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@66353ae1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2abfab01),segFN=segments_2,generation=2}
[junit4:junit4] 2> 441408 T1443 C416 P51277 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 441409 T1443 C416 P51277 oass.SolrIndexSearcher.<init> Opening Searcher@2bab8053 realtime
[junit4:junit4] 2> 441409 T1443 C416 P51277 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 441410 T1443 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 441411 T1486 C415 P51283 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 441435 T1486 C415 P51283 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 441457 T1444 C416 P51277 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 441457 T1444 C416 P51277 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 441458 T1486 C415 P51283 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 441459 T1486 C415 P51283 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 441459 T1486 C415 P51283 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 441461 T1444 C416 P51277 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 441462 T1486 C415 P51283 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 441464 T1486 C415 P51283 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index.20130525073233423
[junit4:junit4] 2> 441464 T1486 C415 P51283 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@38e504a6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@56e7e073) fullCopy=false
[junit4:junit4] 2> 441467 T1444 C416 P51277 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 441469 T1486 C415 P51283 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 441469 T1486 C415 P51283 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 441470 T1486 C415 P51283 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 441472 T1486 C415 P51283 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e166dbe lockFactory=org.apache.lucene.store.NativeFSLockFactory@68bf7916),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e166dbe lockFactory=org.apache.lucene.store.NativeFSLockFactory@68bf7916),segFN=segments_2,generation=2}
[junit4:junit4] 2> 441472 T1486 C415 P51283 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 441473 T1486 C415 P51283 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 441473 T1486 C415 P51283 oass.SolrIndexSearcher.<init> Opening Searcher@6ea7a946 main
[junit4:junit4] 2> 441475 T1485 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6ea7a946 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 441475 T1486 C415 P51283 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index.20130525073233423 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index.20130525073233423;done=true>>]
[junit4:junit4] 2> 441476 T1486 C415 P51283 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index.20130525073233423
[junit4:junit4] 2> 441476 T1486 C415 P51283 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index.20130525073233423
[junit4:junit4] 2> 441476 T1486 C415 P51283 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 441476 T1486 C415 P51283 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 441477 T1486 C415 P51283 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 441477 T1486 C415 P51283 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 441481 T1486 C415 P51283 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 441543 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 441544 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51287__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51287_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51287"}
[junit4:junit4] 2> 441550 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51283__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51283_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51283"}
[junit4:junit4] 2> 441562 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 441563 T1500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 441563 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 441563 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 441563 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 441562 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 441777 T1457 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:51287__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 441777 T1457 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:51287__collection1&state=recovering&nodeName=127.0.0.1:51287_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 441779 T1409 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 442783 T1409 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C414_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51287_, base_url=http://127.0.0.1:51287}
[junit4:junit4] 2> 443779 T1503 C414 P51287 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51280/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 443779 T1503 C414 P51287 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51287 START replicas=[http://127.0.0.1:51280/collection1/] nUpdates=100
[junit4:junit4] 2> 443780 T1503 C414 P51287 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 443780 T1503 C414 P51287 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 443780 T1503 C414 P51287 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 443780 T1503 C414 P51287 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 443781 T1503 C414 P51287 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 443781 T1503 C414 P51287 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51280/collection1/. core=collection1
[junit4:junit4] 2> 443782 T1503 C414 P51287 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 443785 T1409 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C417 name=collection1 org.apache.solr.core.SolrCore@7c851595 url=http://127.0.0.1:51280/collection1 node=127.0.0.1:51280_ C417_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51280_, base_url=http://127.0.0.1:51280, leader=true}
[junit4:junit4] 2> 443789 T1458 C417 P51280 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 443795 T1459 C417 P51280 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 443798 T1459 C417 P51280 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64cffe20 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28189138),segFN=segments_1,generation=1}
[junit4:junit4] 2> 443799 T1459 C417 P51280 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 443800 T1459 C417 P51280 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64cffe20 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28189138),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64cffe20 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28189138),segFN=segments_2,generation=2}
[junit4:junit4] 2> 443800 T1459 C417 P51280 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 443801 T1459 C417 P51280 oass.SolrIndexSearcher.<init> Opening Searcher@1b4675c realtime
[junit4:junit4] 2> 443801 T1459 C417 P51280 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 443802 T1459 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 443803 T1503 C414 P51287 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 443803 T1503 C414 P51287 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 443805 T1460 C417 P51280 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 443805 T1460 C417 P51280 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 443806 T1503 C414 P51287 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 443807 T1503 C414 P51287 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 443807 T1503 C414 P51287 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 443809 T1460 C417 P51280 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 443810 T1503 C414 P51287 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 443811 T1503 C414 P51287 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4/index.20130525073235770
[junit4:junit4] 2> 443811 T1503 C414 P51287 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2e6cc56b lockFactory=org.apache.lucene.store.NativeFSLockFactory@51686df6) fullCopy=false
[junit4:junit4] 2> 443814 T1460 C417 P51280 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 443815 T1503 C414 P51287 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 443816 T1503 C414 P51287 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 443816 T1503 C414 P51287 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 443818 T1503 C414 P51287 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e97cf8f lockFactory=org.apache.lucene.store.NativeFSLockFactory@10ec9245),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e97cf8f lockFactory=org.apache.lucene.store.NativeFSLockFactory@10ec9245),segFN=segments_2,generation=2}
[junit4:junit4] 2> 443818 T1503 C414 P51287 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 443819 T1503 C414 P51287 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 443819 T1503 C414 P51287 oass.SolrIndexSearcher.<init> Opening Searcher@72db0490 main
[junit4:junit4] 2> 443820 T1502 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@72db0490 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 443821 T1503 C414 P51287 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4/index.20130525073235770 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4/index.20130525073235770;done=true>>]
[junit4:junit4] 2> 443821 T1503 C414 P51287 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4/index.20130525073235770
[junit4:junit4] 2> 443822 T1503 C414 P51287 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty4/index.20130525073235770
[junit4:junit4] 2> 443822 T1503 C414 P51287 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 443822 T1503 C414 P51287 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 443822 T1503 C414 P51287 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 443822 T1503 C414 P51287 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 443825 T1503 C414 P51287 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 444573 T1432 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 444574 T1432 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51287__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51287_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51287"}
[junit4:junit4] 2> 444590 T1467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444590 T1431 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444590 T1500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444590 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444590 T1451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444590 T1438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 444789 T1409 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 444790 T1409 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C418 name=collection1 org.apache.solr.core.SolrCore@2d5ef929 url=http://127.0.0.1:51273/collection1 node=127.0.0.1:51273_ C418_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:51273_, base_url=http://127.0.0.1:51273, leader=true}
[junit4:junit4] 2> 444800 T1421 C418 P51273 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 444803 T1421 C418 P51273 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c46649d lockFactory=org.apache.lucene.store.NativeFSLockFactory@7922042e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 444803 T1421 C418 P51273 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 444804 T1421 C418 P51273 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c46649d lockFactory=org.apache.lucene.store.NativeFSLockFactory@7922042e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c46649d lockFactory=org.apache.lucene.store.NativeFSLockFactory@7922042e),segFN=segments_2,generation=2}
[junit4:junit4] 2> 444805 T1421 C418 P51273 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 444805 T1421 C418 P51273 oass.SolrIndexSearcher.<init> Opening Searcher@932ac7a main
[junit4:junit4] 2> 444806 T1421 C418 P51273 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 444807 T1435 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@932ac7a main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 444807 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 444820 T1461 C417 P51280 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 444821 T1461 C417 P51280 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64cffe20 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28189138),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64cffe20 lockFactory=org.apache.lucene.store.NativeFSLockFactory@28189138),segFN=segments_3,generation=3}
[junit4:junit4] 2> 444822 T1461 C417 P51280 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 444822 T1461 C417 P51280 oass.SolrIndexSearcher.<init> Opening Searcher@4bb0ae47 main
[junit4:junit4] 2> 444823 T1461 C417 P51280 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 444824 T1469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4bb0ae47 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 444824 T1461 C417 P51280 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:51277/collection1/, StdNode: http://127.0.0.1:51283/collection1/, StdNode: http://127.0.0.1:51287/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 444827 T1445 C416 P51277 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 444829 T1445 C416 P51277 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@66353ae1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2abfab01),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@66353ae1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2abfab01),segFN=segments_3,generation=3}
[junit4:junit4] 2> 444829 T1445 C416 P51277 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 444830 T1445 C416 P51277 oass.SolrIndexSearcher.<init> Opening Searcher@13ea1528 main
[junit4:junit4] 2> 444830 T1445 C416 P51277 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 444831 T1453 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13ea1528 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 444832 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C414_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51287_, base_url=http://127.0.0.1:51287}
[junit4:junit4] 2> 444835 T1490 C414 P51287 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C415_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51283_, base_url=http://127.0.0.1:51283}
[junit4:junit4] 2> 444835 T1473 C415 P51283 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 444837 T1490 C414 P51287 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e97cf8f lockFactory=org.apache.lucene.store.NativeFSLockFactory@10ec9245),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e97cf8f lockFactory=org.apache.lucene.store.NativeFSLockFactory@10ec9245),segFN=segments_3,generation=3}
[junit4:junit4] 2> 444838 T1473 C415 P51283 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e166dbe lockFactory=org.apache.lucene.store.NativeFSLockFactory@68bf7916),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e166dbe lockFactory=org.apache.lucene.store.NativeFSLockFactory@68bf7916),segFN=segments_3,generation=3}
[junit4:junit4] 2> 444838 T1490 C414 P51287 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 444838 T1473 C415 P51283 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 444839 T1490 C414 P51287 oass.SolrIndexSearcher.<init> Opening Searcher@6e56d65b main
[junit4:junit4] 2> 444840 T1473 C415 P51283 oass.SolrIndexSearcher.<init> Opening Searcher@987e485 main
[junit4:junit4] 2> 444840 T1490 C414 P51287 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 444840 T1473 C415 P51283 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 444841 T1502 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e56d65b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 444841 T1485 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@987e485 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 444842 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 444842 T1473 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 444843 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 23
[junit4:junit4] 2> 444844 T1409 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 444848 T1446 C416 P51277 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 444850 T1474 C415 P51283 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 444853 T1462 C417 P51280 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 444855 T1491 C414 P51287 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 446861 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436009269894840320)} 0 2
[junit4:junit4] 2> 446870 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1436009269899034624&update.from=http://127.0.0.1:51277/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436009269899034624)} 0 2
[junit4:junit4] 2> 446875 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1436009269904277504&update.from=http://127.0.0.1:51280/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436009269904277504)} 0 2
[junit4:junit4] 2> 446876 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1436009269904277504)} 0 8
[junit4:junit4] 2> 446876 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436009269899034624)} 0 12
[junit4:junit4] 2> 446880 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1436009269914763264)]} 0 1
[junit4:junit4] 2> 446887 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1436009269918957568)]} 0 1
[junit4:junit4] 2> 446887 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1436009269918957568)]} 0 4
[junit4:junit4] 2> 446891 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1436009269926297600)]} 0 1
[junit4:junit4] 2> 446901 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1436009269933637632)]} 0 1
[junit4:junit4] 2> 446902 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!1 (1436009269933637632)]} 0 5
[junit4:junit4] 2> 446902 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1]} 0 8
[junit4:junit4] 2> 446906 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1436009269942026240)]} 0 1
[junit4:junit4] 2> 446915 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1436009269948317696)]} 0 1
[junit4:junit4] 2> 446915 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1436009269948317696)]} 0 4
[junit4:junit4] 2> 446916 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2]} 0 8
[junit4:junit4] 2> 446919 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1436009269956706304)]} 0 0
[junit4:junit4] 2> 446928 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1436009269962997760)]} 0 0
[junit4:junit4] 2> 446929 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!3 (1436009269962997760)]} 0 4
[junit4:junit4] 2> 446930 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3]} 0 8
[junit4:junit4] 2> 446934 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1436009269971386368)]} 0 1
[junit4:junit4] 2> 446941 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1436009269975580672)]} 0 1
[junit4:junit4] 2> 446941 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1436009269975580672)]} 0 4
[junit4:junit4] 2> 446944 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1436009269982920704)]} 0 0
[junit4:junit4] 2> 446950 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1436009269986066432)]} 0 0
[junit4:junit4] 2> 446951 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1436009269986066432)]} 0 4
[junit4:junit4] 2> 446954 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1436009269993406464)]} 0 0
[junit4:junit4] 2> 446963 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1436009269998649344)]} 0 1
[junit4:junit4] 2> 446963 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1436009269998649344)]} 0 4
[junit4:junit4] 2> 446964 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6]} 0 7
[junit4:junit4] 2> 446967 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1436009270007037952)]} 0 0
[junit4:junit4] 2> 446974 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1436009270010183680)]} 0 1
[junit4:junit4] 2> 446974 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1436009270010183680)]} 0 4
[junit4:junit4] 2> 446977 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1436009270017523712)]} 0 0
[junit4:junit4] 2> 446986 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1436009270023815168)]} 0 0
[junit4:junit4] 2> 446987 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!8 (1436009270023815168)]} 0 4
[junit4:junit4] 2> 446988 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8]} 0 8
[junit4:junit4] 2> 446991 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1436009270032203776)]} 0 0
[junit4:junit4] 2> 447001 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1436009270038495232)]} 0 1
[junit4:junit4] 2> 447001 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!9 (1436009270038495232)]} 0 4
[junit4:junit4] 2> 447002 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9]} 0 8
[junit4:junit4] 2> 447005 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1436009270046883840)]} 0 0
[junit4:junit4] 2> 447013 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1436009270052126720)]} 0 0
[junit4:junit4] 2> 447014 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1436009270052126720)]} 0 4
[junit4:junit4] 2> 447015 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10]} 0 7
[junit4:junit4] 2> 447018 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1436009270060515328)]} 0 0
[junit4:junit4] 2> 447026 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1436009270065758208)]} 0 0
[junit4:junit4] 2> 447027 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1436009270065758208)]} 0 4
[junit4:junit4] 2> 447028 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11]} 0 7
[junit4:junit4] 2> 447031 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1436009270074146816)]} 0 0
[junit4:junit4] 2> 447039 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1436009270079389696)]} 0 0
[junit4:junit4] 2> 447040 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1436009270079389696)]} 0 4
[junit4:junit4] 2> 447041 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12]} 0 7
[junit4:junit4] 2> 447045 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1436009270087778304)]} 0 1
[junit4:junit4] 2> 447054 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1436009270094069760)]} 0 1
[junit4:junit4] 2> 447054 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1436009270094069760)]} 0 4
[junit4:junit4] 2> 447055 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13]} 0 7
[junit4:junit4] 2> 447058 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1436009270102458368)]} 0 0
[junit4:junit4] 2> 447066 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1436009270107701248)]} 0 0
[junit4:junit4] 2> 447067 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!14 (1436009270107701248)]} 0 4
[junit4:junit4] 2> 447068 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14]} 0 7
[junit4:junit4] 2> 447072 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1436009270116089856)]} 0 1
[junit4:junit4] 2> 447078 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1436009270119235584)]} 0 1
[junit4:junit4] 2> 447078 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1436009270119235584)]} 0 4
[junit4:junit4] 2> 447082 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1436009270126575616)]} 0 1
[junit4:junit4] 2> 447089 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1436009270131818496)]} 0 0
[junit4:junit4] 2> 447090 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1436009270131818496)]} 0 4
[junit4:junit4] 2> 447091 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16]} 0 7
[junit4:junit4] 2> 447095 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1436009270140207104)]} 0 1
[junit4:junit4] 2> 447104 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1436009270146498560)]} 0 1
[junit4:junit4] 2> 447104 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!17 (1436009270146498560)]} 0 4
[junit4:junit4] 2> 447105 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17]} 0 7
[junit4:junit4] 2> 447109 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1436009270154887168)]} 0 1
[junit4:junit4] 2> 447114 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1436009270158032896)]} 0 0
[junit4:junit4] 2> 447115 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1436009270158032896)]} 0 4
[junit4:junit4] 2> 447119 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1436009270165372928)]} 0 1
[junit4:junit4] 2> 447124 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1436009270168518656)]} 0 0
[junit4:junit4] 2> 447125 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1436009270168518656)]} 0 4
[junit4:junit4] 2> 447128 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1436009270175858688)]} 0 0
[junit4:junit4] 2> 447138 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1436009270182150144)]} 0 1
[junit4:junit4] 2> 447138 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1436009270182150144)]} 0 4
[junit4:junit4] 2> 447139 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 8
[junit4:junit4] 2> 447142 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1436009270190538752)]} 0 0
[junit4:junit4] 2> 447149 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1436009270193684480)]} 0 1
[junit4:junit4] 2> 447149 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1436009270193684480)]} 0 4
[junit4:junit4] 2> 447152 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1436009270201024512)]} 0 0
[junit4:junit4] 2> 447161 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1436009270206267392)]} 0 1
[junit4:junit4] 2> 447161 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!22 (1436009270206267392)]} 0 4
[junit4:junit4] 2> 447162 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22]} 0 7
[junit4:junit4] 2> 447166 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1436009270214656000)]} 0 1
[junit4:junit4] 2> 447175 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1436009270220947456)]} 0 1
[junit4:junit4] 2> 447175 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1436009270220947456)]} 0 4
[junit4:junit4] 2> 447176 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23]} 0 8
[junit4:junit4] 2> 447179 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1436009270229336064)]} 0 0
[junit4:junit4] 2> 447186 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1436009270232481792)]} 0 1
[junit4:junit4] 2> 447186 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1436009270232481792)]} 0 4
[junit4:junit4] 2> 447189 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1436009270239821824)]} 0 0
[junit4:junit4] 2> 447198 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1436009270246113280)]} 0 0
[junit4:junit4] 2> 447199 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1436009270246113280)]} 0 4
[junit4:junit4] 2> 447200 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25]} 0 8
[junit4:junit4] 2> 447203 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1436009270254501888)]} 0 0
[junit4:junit4] 2> 447212 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1436009270259744768)]} 0 1
[junit4:junit4] 2> 447213 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!26 (1436009270259744768)]} 0 5
[junit4:junit4] 2> 447213 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26]} 0 7
[junit4:junit4] 2> 447217 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1436009270268133376)]} 0 1
[junit4:junit4] 2> 447224 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1436009270273376256)]} 0 0
[junit4:junit4] 2> 447225 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1436009270273376256)]} 0 4
[junit4:junit4] 2> 447226 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 7
[junit4:junit4] 2> 447229 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1436009270281764864)]} 0 0
[junit4:junit4] 2> 447237 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1436009270287007744)]} 0 0
[junit4:junit4] 2> 447238 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1436009270287007744)]} 0 4
[junit4:junit4] 2> 447239 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 7
[junit4:junit4] 2> 447242 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1436009270295396352)]} 0 0
[junit4:junit4] 2> 447248 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1436009270298542080)]} 0 0
[junit4:junit4] 2> 447249 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1436009270298542080)]} 0 4
[junit4:junit4] 2> 447252 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1436009270305882112)]} 0 0
[junit4:junit4] 2> 447258 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1436009270309027840)]} 0 0
[junit4:junit4] 2> 447259 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1436009270309027840)]} 0 4
[junit4:junit4] 2> 447262 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1436009270316367872)]} 0 0
[junit4:junit4] 2> 447270 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1436009270321610752)]} 0 0
[junit4:junit4] 2> 447271 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1436009270321610752)]} 0 4
[junit4:junit4] 2> 447272 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31]} 0 7
[junit4:junit4] 2> 447276 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1436009270329999360)]} 0 1
[junit4:junit4] 2> 447282 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1436009270333145088)]} 0 1
[junit4:junit4] 2> 447282 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1436009270333145088)]} 0 4
[junit4:junit4] 2> 447285 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1436009270340485120)]} 0 0
[junit4:junit4] 2> 447291 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1436009270343630848)]} 0 0
[junit4:junit4] 2> 447292 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1436009270343630848)]} 0 4
[junit4:junit4] 2> 447295 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1436009270350970880)]} 0 0
[junit4:junit4] 2> 447305 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1436009270357262336)]} 0 1
[junit4:junit4] 2> 447305 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1436009270357262336)]} 0 4
[junit4:junit4] 2> 447306 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34]} 0 8
[junit4:junit4] 2> 447310 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1436009270365650944)]} 0 1
[junit4:junit4] 2> 447315 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1436009270368796672)]} 0 0
[junit4:junit4] 2> 447316 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1436009270368796672)]} 0 4
[junit4:junit4] 2> 447319 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1436009270376136704)]} 0 0
[junit4:junit4] 2> 447327 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1436009270381379584)]} 0 0
[junit4:junit4] 2> 447328 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1436009270381379584)]} 0 4
[junit4:junit4] 2> 447329 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36]} 0 7
[junit4:junit4] 2> 447333 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1436009270389768192)]} 0 1
[junit4:junit4] 2> 447339 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1436009270392913920)]} 0 1
[junit4:junit4] 2> 447340 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1436009270392913920)]} 0 5
[junit4:junit4] 2> 447342 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1436009270400253952)]} 0 0
[junit4:junit4] 2> 447349 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1436009270403399680)]} 0 0
[junit4:junit4] 2> 447349 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1436009270403399680)]} 0 4
[junit4:junit4] 2> 447352 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1436009270410739712)]} 0 0
[junit4:junit4] 2> 447361 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1436009270417031168)]} 0 0
[junit4:junit4] 2> 447362 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1436009270417031168)]} 0 4
[junit4:junit4] 2> 447363 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39]} 0 8
[junit4:junit4] 2> 447366 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1436009270425419776)]} 0 0
[junit4:junit4] 2> 447372 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1436009270428565504)]} 0 0
[junit4:junit4] 2> 447373 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1436009270428565504)]} 0 4
[junit4:junit4] 2> 447377 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1436009270435905536)]} 0 1
[junit4:junit4] 2> 447383 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1436009270439051264)]} 0 0
[junit4:junit4] 2> 447383 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1436009270439051264)]} 0 4
[junit4:junit4] 2> 447387 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1436009270446391296)]} 0 1
[junit4:junit4] 2> 447394 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1436009270450585600)]} 0 1
[junit4:junit4] 2> 447394 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1436009270450585600)]} 0 4
[junit4:junit4] 2> 447398 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1436009270457925632)]} 0 1
[junit4:junit4] 2> 447406 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1436009270463168512)]} 0 1
[junit4:junit4] 2> 447406 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!43 (1436009270463168512)]} 0 4
[junit4:junit4] 2> 447407 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43]} 0 7
[junit4:junit4] 2> 447411 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1436009270471557120)]} 0 1
[junit4:junit4] 2> 447418 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1436009270475751424)]} 0 1
[junit4:junit4] 2> 447418 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1436009270475751424)]} 0 4
[junit4:junit4] 2> 447421 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1436009270483091456)]} 0 0
[junit4:junit4] 2> 447431 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1436009270489382912)]} 0 1
[junit4:junit4] 2> 447431 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!45 (1436009270489382912)]} 0 4
[junit4:junit4] 2> 447432 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45]} 0 8
[junit4:junit4] 2> 447435 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1436009270497771520)]} 0 0
[junit4:junit4] 2> 447442 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1436009270500917248)]} 0 1
[junit4:junit4] 2> 447442 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1436009270500917248)]} 0 4
[junit4:junit4] 2> 447445 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1436009270508257280)]} 0 0
[junit4:junit4] 2> 447453 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1436009270513500160)]} 0 0
[junit4:junit4] 2> 447454 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1436009270513500160)]} 0 4
[junit4:junit4] 2> 447455 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 7
[junit4:junit4] 2> 447459 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1436009270521888768)]} 0 1
[junit4:junit4] 2> 447467 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1436009270527131648)]} 0 1
[junit4:junit4] 2> 447467 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!48 (1436009270527131648)]} 0 4
[junit4:junit4] 2> 447468 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48]} 0 7
[junit4:junit4] 2> 447472 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1436009270535520256)]} 0 1
[junit4:junit4] 2> 447480 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1436009270540763136)]} 0 1
[junit4:junit4] 2> 447480 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1436009270540763136)]} 0 4
[junit4:junit4] 2> 447481 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49]} 0 7
[junit4:junit4] 2> 447484 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1436009270549151744)]} 0 0
[junit4:junit4] 2> 447494 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1436009270555443200)]} 0 1
[junit4:junit4] 2> 447494 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!50 (1436009270555443200)]} 0 4
[junit4:junit4] 2> 447495 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50]} 0 8
[junit4:junit4] 2> 447498 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1436009270563831808)]} 0 0
[junit4:junit4] 2> 447506 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1436009270569074688)]} 0 0
[junit4:junit4] 2> 447507 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!51 (1436009270569074688)]} 0 4
[junit4:junit4] 2> 447508 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51]} 0 7
[junit4:junit4] 2> 447511 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1436009270577463296)]} 0 0
[junit4:junit4] 2> 447517 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1436009270580609024)]} 0 0
[junit4:junit4] 2> 447518 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1436009270580609024)]} 0 4
[junit4:junit4] 2> 447522 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1436009270587949056)]} 0 1
[junit4:junit4] 2> 447530 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1436009270593191936)]} 0 1
[junit4:junit4] 2> 447530 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1436009270593191936)]} 0 4
[junit4:junit4] 2> 447531 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53]} 0 7
[junit4:junit4] 2> 447534 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1436009270601580544)]} 0 0
[junit4:junit4] 2> 447541 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1436009270604726272)]} 0 0
[junit4:junit4] 2> 447541 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1436009270604726272)]} 0 4
[junit4:junit4] 2> 447545 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1436009270612066304)]} 0 0
[junit4:junit4] 2> 447552 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1436009270617309184)]} 0 0
[junit4:junit4] 2> 447553 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1436009270617309184)]} 0 4
[junit4:junit4] 2> 447554 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55]} 0 7
[junit4:junit4] 2> 447558 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1436009270625697792)]} 0 0
[junit4:junit4] 2> 447564 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1436009270628843520)]} 0 1
[junit4:junit4] 2> 447564 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1436009270628843520)]} 0 4
[junit4:junit4] 2> 447567 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1436009270636183552)]} 0 0
[junit4:junit4] 2> 447574 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1436009270639329280)]} 0 1
[junit4:junit4] 2> 447574 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1436009270639329280)]} 0 4
[junit4:junit4] 2> 447577 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1436009270646669312)]} 0 0
[junit4:junit4] 2> 447583 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1436009270649815040)]} 0 0
[junit4:junit4] 2> 447584 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1436009270649815040)]} 0 4
[junit4:junit4] 2> 447587 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1436009270657155072)]} 0 0
[junit4:junit4] 2> 447594 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1436009270660300800)]} 0 0
[junit4:junit4] 2> 447594 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1436009270660300800)]} 0 4
[junit4:junit4] 2> 447597 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1436009270667640832)]} 0 0
[junit4:junit4] 2> 447603 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1436009270670786560)]} 0 0
[junit4:junit4] 2> 447604 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1436009270670786560)]} 0 4
[junit4:junit4] 2> 447607 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1436009270678126592)]} 0 0
[junit4:junit4] 2> 447616 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1436009270683369472)]} 0 1
[junit4:junit4] 2> 447616 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!61 (1436009270683369472)]} 0 4
[junit4:junit4] 2> 447617 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61]} 0 7
[junit4:junit4] 2> 447620 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1436009270691758080)]} 0 0
[junit4:junit4] 2> 447626 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1436009270694903808)]} 0 0
[junit4:junit4] 2> 447627 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1436009270694903808)]} 0 4
[junit4:junit4] 2> 447630 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1436009270702243840)]} 0 0
[junit4:junit4] 2> 447637 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1436009270705389568)]} 0 1
[junit4:junit4] 2> 447637 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1436009270705389568)]} 0 4
[junit4:junit4] 2> 447641 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1436009270712729600)]} 0 1
[junit4:junit4] 2> 447649 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1436009270717972480)]} 0 1
[junit4:junit4] 2> 447649 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!64 (1436009270717972480)]} 0 4
[junit4:junit4] 2> 447650 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64]} 0 7
[junit4:junit4] 2> 447653 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1436009270726361088)]} 0 0
[junit4:junit4] 2> 447660 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1436009270729506816)]} 0 1
[junit4:junit4] 2> 447660 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1436009270729506816)]} 0 4
[junit4:junit4] 2> 447664 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1436009270736846848)]} 0 1
[junit4:junit4] 2> 447672 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1436009270742089728)]} 0 1
[junit4:junit4] 2> 447672 T1463 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1436009270742089728)]} 0 4
[junit4:junit4] 2> 447673 T1447 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66]} 0 7
[junit4:junit4] 2> 447677 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1436009270750478336)]} 0 1
[junit4:junit4] 2> 447685 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1436009270755721216)]} 0 0
[junit4:junit4] 2> 447685 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!67 (1436009270755721216)]} 0 4
[junit4:junit4] 2> 447686 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67]} 0 7
[junit4:junit4] 2> 447689 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1436009270764109824)]} 0 0
[junit4:junit4] 2> 447697 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51277/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1436009270769352704)]} 0 0
[junit4:junit4] 2> 447698 T1445 C416 P51277 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!68 (1436009270769352704)]} 0 4
[junit4:junit4] 2> 447699 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68]} 0 7
[junit4:junit4] 2> 447702 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69 (1436009270777741312)]} 0 0
[junit4:junit4] 2> 447708 T1490 C414 P51287 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:51280/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!69 (1436009270780887040)]} 0 0
[junit4:junit4] 2> 447709 T1461 C417 P51280 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69 (1436009270780887040)]} 0 4
[junit4:junit4] 2> 447713 T1421 C418 P51273 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!70 (1436009270788227072)]} 0 1
[junit4:junit4] 2> 447720 T1475 C415 P51283 oasup.LogUpdateProcessor.finish [collection1] w
[...truncated too long message...]
ve! I am the leader
[junit4:junit4] 2> 483543 T1483 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51283/collection1/
[junit4:junit4] 2> 483543 T1483 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1a44c68a
[junit4:junit4] 2> 483544 T1483 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=10,adds=10,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=69,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 483545 T1483 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 483545 T1483 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 483546 T1483 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> ASYNC NEW_CORE C433 name=collection1 org.apache.solr.core.SolrCore@1a44c68a url=http://127.0.0.1:51283/collection1 node=127.0.0.1:51283_ C433_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51283_, base_url=http://127.0.0.1:51283}
[junit4:junit4] 2> 483547 T1483 C433 P51283 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e166dbe lockFactory=org.apache.lucene.store.NativeFSLockFactory@68bf7916),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e166dbe lockFactory=org.apache.lucene.store.NativeFSLockFactory@68bf7916),segFN=segments_5,generation=5}
[junit4:junit4] 2> 483548 T1483 C433 P51283 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 483551 T1483 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 483551 T1483 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 483552 T1483 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3;done=false>>]
[junit4:junit4] 2> 483552 T1483 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3
[junit4:junit4] 2> 483552 T1483 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index;done=false>>]
[junit4:junit4] 2> 483552 T1483 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369485132732/jetty3/index
[junit4:junit4] 2> 483553 T1483 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 483553 T1483 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89750577659248650-127.0.0.1:51283__collection1-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 483554 T1483 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 483554 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 483554 T1483 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 483555 T1483 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 483555 T1483 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 483555 T1483 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=482), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=482)), sim=DefaultSimilarity, locale=pt, timezone=America/Monterrey
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=125486280,total=399507456
[junit4:junit4] 2> NOTE: All tests run in this JVM: [SpatialFilterTest, DistributedSpellCheckComponentTest, TestLFUCache, TestReversedWildcardFilterFactory, SoftAutoCommitTest, TestManagedSchemaFieldResource, TestPropInjectDefaults, UUIDFieldTest, SchemaVersionSpecificBehaviorTest, DateFieldTest, SliceStateTest, DocumentBuilderTest, DirectSolrConnectionTest, TestReplicationHandler, MoreLikeThisHandlerTest, TestPhraseSuggestions, TestSearchPerf, TestWriterPerf, TestRandomDVFaceting, ResourceLoaderTest, DocValuesTest, TestLMDirichletSimilarityFactory, SolrCoreTest, BasicFunctionalityTest, ZkControllerTest, CircularListTest, TestSchemaResource, TestSolrIndexConfig, TestStressVersions, BadCopyFieldTest, TestSurroundQueryParser, RecoveryZkTest, TestUniqueKeyFieldResource, BinaryUpdateRequestHandlerTest, QueryResultKeyTest, TestManagedSchema, JsonLoaderTest, DirectUpdateHandlerOptimizeTest, SolrInfoMBeanTest, TestBadConfig, QueryParsingTest, SolrIndexSplitterTest, TestDocSet, TestPerFieldSimilarity, DistributedQueryElevationComponentTest, ShardSplitTest]
[junit4:junit4] Completed on J0 in 63.38s, 1 test, 1 error <<< FAILURES!
[...truncated 647 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:380: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:360: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 error, 13 ignored (7 assumptions)
Total time: 51 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4015 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4015/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:45547 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:45547 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([94A54365A6889114:1543CD7DD1D7F128]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 10076 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 1957527 T4382 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 1957533 T4382 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1369452793670
[junit4:junit4] 2> 1957535 T4382 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1957536 T4383 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1957637 T4382 oasc.ZkTestServer.run start zk server on port:58596
[junit4:junit4] 2> 1957638 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1957646 T4389 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e43363 name:ZooKeeperConnection Watcher:127.0.0.1:58596 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1957647 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1957647 T4382 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1957666 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1957683 T4391 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a6a7cbd name:ZooKeeperConnection Watcher:127.0.0.1:58596/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1957683 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1957684 T4382 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1957724 T4382 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1957727 T4382 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1957730 T4382 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1957743 T4382 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1957744 T4382 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1957749 T4382 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1957750 T4382 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1957859 T4382 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1957860 T4382 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1957920 T4382 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1957922 T4382 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1957925 T4382 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1957926 T4382 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1957929 T4382 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1957930 T4382 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1957949 T4382 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1957949 T4382 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1957953 T4382 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1957954 T4382 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1957958 T4382 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1957959 T4382 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1958237 T4382 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1958241 T4382 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32866
[junit4:junit4] 2> 1958242 T4382 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1958242 T4382 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1958243 T4382 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369452794104
[junit4:junit4] 2> 1958243 T4382 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369452794104/solr.xml
[junit4:junit4] 2> 1958244 T4382 oasc.CoreContainer.<init> New CoreContainer 603944156
[junit4:junit4] 2> 1958245 T4382 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369452794104/'
[junit4:junit4] 2> 1958246 T4382 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369452794104/'
[junit4:junit4] 2> 1958384 T4382 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1958386 T4382 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1958386 T4382 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1958387 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1958387 T4382 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1958388 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1958389 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1958389 T4382 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1958390 T4382 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1958390 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1958408 T4382 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1958410 T4382 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58596/solr
[junit4:junit4] 2> 1958410 T4382 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1958412 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1958415 T4402 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@428f21ef name:ZooKeeperConnection Watcher:127.0.0.1:58596 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1958416 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1958419 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1958432 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1958434 T4404 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43847e28 name:ZooKeeperConnection Watcher:127.0.0.1:58596/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1958434 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1958449 T4382 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1958461 T4382 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1958465 T4382 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1958467 T4382 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32866_
[junit4:junit4] 2> 1958474 T4382 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32866_
[junit4:junit4] 2> 1958478 T4382 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1958494 T4382 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1958522 T4382 oasc.Overseer.start Overseer (id=89748458286415875-127.0.0.1:32866_-n_0000000000) starting
[junit4:junit4] 2> 1958535 T4382 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1958556 T4406 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1958556 T4382 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1958563 T4382 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1958581 T4382 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1958584 T4405 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1958588 T4407 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369452794104/collection1
[junit4:junit4] 2> 1958588 T4407 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1958589 T4407 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1958589 T4407 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1958591 T4407 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369452794104/collection1/'
[junit4:junit4] 2> 1958593 T4407 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1369452794104/collection1/lib/README' to classloader
[junit4:junit4] 2> 1958594 T4407 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1369452794104/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1958655 T4407 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1958719 T4407 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1958821 T4407 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1958836 T4407 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1959450 T4407 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1959454 T4407 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1959457 T4407 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1959463 T4407 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1959511 T4407 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1959512 T4407 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369452794104/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369452793669/control/data/
[junit4:junit4] 2> 1959512 T4407 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d671e3c
[junit4:junit4] 2> 1959513 T4407 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1959514 T4407 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/control/data
[junit4:junit4] 2> 1959514 T4407 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369452793669/control/data/index/
[junit4:junit4] 2> 1959515 T4407 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369452793669/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1959515 T4407 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/control/data/index
[junit4:junit4] 2> 1959520 T4407 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f616c13 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5bc159a3),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1959521 T4407 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1959539 T4407 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1959540 T4407 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1959540 T4407 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1959541 T4407 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1959542 T4407 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1959542 T4407 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1959542 T4407 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1959543 T4407 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1959544 T4407 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1959564 T4407 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1959572 T4407 oass.SolrIndexSearcher.<init> Opening Searcher@63a1358a main
[junit4:junit4] 2> 1959573 T4407 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369452793669/control/data/tlog
[junit4:junit4] 2> 1959574 T4407 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1959575 T4407 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1959579 T4408 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@63a1358a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1959581 T4407 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1959581 T4407 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1960087 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1960088 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:32866_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32866"}
[junit4:junit4] 2> 1960089 T4405 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1960089 T4405 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1960110 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1960585 T4407 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1960585 T4407 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:32866 collection:control_collection shard:shard1
[junit4:junit4] 2> 1960587 T4407 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1960615 T4407 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1960645 T4407 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1960646 T4407 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1960646 T4407 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:32866/collection1/
[junit4:junit4] 2> 1960646 T4407 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1960647 T4407 oasc.SyncStrategy.syncToMe http://127.0.0.1:32866/collection1/ has no replicas
[junit4:junit4] 2> 1960647 T4407 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:32866/collection1/
[junit4:junit4] 2> 1960647 T4407 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1961616 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1961652 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1961658 T4407 oasc.ZkController.register We are http://127.0.0.1:32866/collection1/ and leader is http://127.0.0.1:32866/collection1/
[junit4:junit4] 2> 1961658 T4407 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32866
[junit4:junit4] 2> 1961658 T4407 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1961659 T4407 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1961659 T4407 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1961674 T4407 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1961676 T4382 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1961677 T4382 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1961677 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1961694 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1961696 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1961698 T4411 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62484456 name:ZooKeeperConnection Watcher:127.0.0.1:58596/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1961699 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1961701 T4382 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1961704 T4382 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1961997 T4382 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1962000 T4382 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45547
[junit4:junit4] 2> 1962001 T4382 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1962001 T4382 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1962002 T4382 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369452797839
[junit4:junit4] 2> 1962003 T4382 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369452797839/solr.xml
[junit4:junit4] 2> 1962003 T4382 oasc.CoreContainer.<init> New CoreContainer 1339802217
[junit4:junit4] 2> 1962004 T4382 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369452797839/'
[junit4:junit4] 2> 1962005 T4382 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369452797839/'
[junit4:junit4] 2> 1962170 T4382 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1962172 T4382 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1962172 T4382 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1962173 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1962173 T4382 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1962174 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1962174 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1962175 T4382 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1962176 T4382 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1962176 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1962193 T4382 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1962194 T4382 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58596/solr
[junit4:junit4] 2> 1962195 T4382 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1962196 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1962199 T4422 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@713a6906 name:ZooKeeperConnection Watcher:127.0.0.1:58596 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1962200 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1962204 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1962215 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1962218 T4424 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@250ffba7 name:ZooKeeperConnection Watcher:127.0.0.1:58596/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1962218 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1962234 T4382 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1963158 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1963159 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:32866__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:32866_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32866"}
[junit4:junit4] 2> 1963182 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1963182 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1963182 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1963238 T4382 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45547_
[junit4:junit4] 2> 1963240 T4382 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45547_
[junit4:junit4] 2> 1963243 T4411 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1963243 T4424 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1963243 T4404 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1963244 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1963243 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1963244 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1963267 T4425 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369452797839/collection1
[junit4:junit4] 2> 1963267 T4425 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1963268 T4425 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1963268 T4425 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1963270 T4425 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369452797839/collection1/'
[junit4:junit4] 2> 1963272 T4425 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1369452797839/collection1/lib/README' to classloader
[junit4:junit4] 2> 1963272 T4425 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1369452797839/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1963333 T4425 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1963403 T4425 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1963504 T4425 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1963518 T4425 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1964115 T4425 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1964119 T4425 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1964122 T4425 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1964127 T4425 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1964147 T4425 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1964147 T4425 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369452797839/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty1/
[junit4:junit4] 2> 1964147 T4425 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d671e3c
[junit4:junit4] 2> 1964148 T4425 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1964149 T4425 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty1
[junit4:junit4] 2> 1964149 T4425 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty1/index/
[junit4:junit4] 2> 1964149 T4425 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1964151 T4425 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty1/index
[junit4:junit4] 2> 1964155 T4425 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f0f057a lockFactory=org.apache.lucene.store.NativeFSLockFactory@15c52c2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1964155 T4425 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1964159 T4425 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1964159 T4425 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1964160 T4425 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1964161 T4425 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1964161 T4425 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1964162 T4425 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1964162 T4425 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1964163 T4425 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1964163 T4425 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1964179 T4425 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1964186 T4425 oass.SolrIndexSearcher.<init> Opening Searcher@18726854 main
[junit4:junit4] 2> 1964186 T4425 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty1/tlog
[junit4:junit4] 2> 1964187 T4425 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1964188 T4425 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1964192 T4426 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18726854 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1964194 T4425 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1964195 T4425 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1964696 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1964697 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45547_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45547"}
[junit4:junit4] 2> 1964697 T4405 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1964698 T4405 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1964720 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1964720 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1964721 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1965197 T4425 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1965197 T4425 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45547 collection:collection1 shard:shard1
[junit4:junit4] 2> 1965198 T4425 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1965244 T4425 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1965255 T4425 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1965256 T4425 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1965256 T4425 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45547/collection1/
[junit4:junit4] 2> 1965256 T4425 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1965257 T4425 oasc.SyncStrategy.syncToMe http://127.0.0.1:45547/collection1/ has no replicas
[junit4:junit4] 2> 1965257 T4425 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45547/collection1/
[junit4:junit4] 2> 1965257 T4425 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1966224 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1966287 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1966287 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1966287 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1966306 T4425 oasc.ZkController.register We are http://127.0.0.1:45547/collection1/ and leader is http://127.0.0.1:45547/collection1/
[junit4:junit4] 2> 1966306 T4425 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45547
[junit4:junit4] 2> 1966306 T4425 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1966307 T4425 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1966307 T4425 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1966309 T4425 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1966310 T4382 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1966311 T4382 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1966312 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1966633 T4382 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1966636 T4382 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29453
[junit4:junit4] 2> 1966637 T4382 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1966638 T4382 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1966638 T4382 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369452802468
[junit4:junit4] 2> 1966639 T4382 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369452802468/solr.xml
[junit4:junit4] 2> 1966639 T4382 oasc.CoreContainer.<init> New CoreContainer 1984949536
[junit4:junit4] 2> 1966640 T4382 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369452802468/'
[junit4:junit4] 2> 1966641 T4382 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369452802468/'
[junit4:junit4] 2> 1966788 T4382 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1966789 T4382 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1966789 T4382 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1966790 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1966791 T4382 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1966791 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1966792 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1966792 T4382 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1966793 T4382 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1966793 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1966811 T4382 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1966812 T4382 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58596/solr
[junit4:junit4] 2> 1966813 T4382 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1966814 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1966817 T4438 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e64ff90 name:ZooKeeperConnection Watcher:127.0.0.1:58596 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1966818 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1966843 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1966855 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1966857 T4440 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@eb20583 name:ZooKeeperConnection Watcher:127.0.0.1:58596/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1966857 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1966877 T4382 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1967800 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1967801 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:45547__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:45547_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:45547"}
[junit4:junit4] 2> 1967821 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1967821 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1967821 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1967821 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1967881 T4382 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29453_
[junit4:junit4] 2> 1967883 T4382 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29453_
[junit4:junit4] 2> 1967898 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1967898 T4404 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1967898 T4411 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1967898 T4424 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1967899 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1967899 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1967899 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1967899 T4440 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1967910 T4441 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369452802468/collection1
[junit4:junit4] 2> 1967910 T4441 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1967911 T4441 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1967911 T4441 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1967913 T4441 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369452802468/collection1/'
[junit4:junit4] 2> 1967914 T4441 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1369452802468/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1967915 T4441 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1369452802468/collection1/lib/README' to classloader
[junit4:junit4] 2> 1967993 T4441 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1968053 T4441 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1968154 T4441 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1968167 T4441 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1968734 T4441 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1968738 T4441 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1968741 T4441 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1968747 T4441 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1968770 T4441 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1968771 T4441 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369452802468/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty2/
[junit4:junit4] 2> 1968771 T4441 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d671e3c
[junit4:junit4] 2> 1968772 T4441 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1968774 T4441 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty2
[junit4:junit4] 2> 1968774 T4441 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty2/index/
[junit4:junit4] 2> 1968775 T4441 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1968775 T4441 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty2/index
[junit4:junit4] 2> 1968779 T4441 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42db251a lockFactory=org.apache.lucene.store.NativeFSLockFactory@60ca3674),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1968780 T4441 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1968784 T4441 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1968784 T4441 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1968785 T4441 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1968786 T4441 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1968786 T4441 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1968787 T4441 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1968787 T4441 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1968788 T4441 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1968788 T4441 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1968806 T4441 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1968814 T4441 oass.SolrIndexSearcher.<init> Opening Searcher@56609a43 main
[junit4:junit4] 2> 1968815 T4441 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty2/tlog
[junit4:junit4] 2> 1968816 T4441 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1968816 T4441 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1968822 T4442 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56609a43 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1968824 T4441 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1968825 T4441 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1969325 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1969326 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29453_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29453"}
[junit4:junit4] 2> 1969327 T4405 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1969327 T4405 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1969407 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1969407 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1969407 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1969407 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1969827 T4441 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1969827 T4441 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29453 collection:collection1 shard:shard2
[junit4:junit4] 2> 1969828 T4441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1969861 T4441 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1969886 T4441 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1969886 T4441 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1969886 T4441 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:29453/collection1/
[junit4:junit4] 2> 1969886 T4441 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1969887 T4441 oasc.SyncStrategy.syncToMe http://127.0.0.1:29453/collection1/ has no replicas
[junit4:junit4] 2> 1969887 T4441 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:29453/collection1/
[junit4:junit4] 2> 1969887 T4441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1970947 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1971019 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1971019 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1971019 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1971019 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1971079 T4441 oasc.ZkController.register We are http://127.0.0.1:29453/collection1/ and leader is http://127.0.0.1:29453/collection1/
[junit4:junit4] 2> 1971079 T4441 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29453
[junit4:junit4] 2> 1971079 T4441 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1971080 T4441 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1971080 T4441 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1971082 T4441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1971083 T4382 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1971084 T4382 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1971084 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1971391 T4382 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1971395 T4382 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52586
[junit4:junit4] 2> 1971396 T4382 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1971397 T4382 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1971397 T4382 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369452807235
[junit4:junit4] 2> 1971398 T4382 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369452807235/solr.xml
[junit4:junit4] 2> 1971399 T4382 oasc.CoreContainer.<init> New CoreContainer 924455113
[junit4:junit4] 2> 1971399 T4382 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369452807235/'
[junit4:junit4] 2> 1971400 T4382 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369452807235/'
[junit4:junit4] 2> 1971532 T4382 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1971533 T4382 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1971534 T4382 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1971534 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1971535 T4382 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1971536 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1971536 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1971537 T4382 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1971537 T4382 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1971538 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1971553 T4382 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1971554 T4382 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58596/solr
[junit4:junit4] 2> 1971555 T4382 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1971556 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1971560 T4454 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6fbc4343 name:ZooKeeperConnection Watcher:127.0.0.1:58596 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1971560 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1971587 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1971598 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1971600 T4456 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21de9b0a name:ZooKeeperConnection Watcher:127.0.0.1:58596/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1971600 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1971619 T4382 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1972552 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1972553 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:29453__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:29453_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29453"}
[junit4:junit4] 2> 1972569 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1972569 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1972569 T4456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1972569 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1972569 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1972622 T4382 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52586_
[junit4:junit4] 2> 1972624 T4382 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52586_
[junit4:junit4] 2> 1972627 T4456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1972627 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1972627 T4424 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1972627 T4411 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1972627 T4404 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1972628 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1972628 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1972628 T4456 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1972628 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1972629 T4440 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1972634 T4457 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369452807235/collection1
[junit4:junit4] 2> 1972635 T4457 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1972635 T4457 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1972636 T4457 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1972637 T4457 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369452807235/collection1/'
[junit4:junit4] 2> 1972639 T4457 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1369452807235/collection1/lib/README' to classloader
[junit4:junit4] 2> 1972639 T4457 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1369452807235/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1972695 T4457 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1972757 T4457 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1972858 T4457 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1972871 T4457 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1973469 T4457 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1973474 T4457 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1973476 T4457 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1973482 T4457 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1973505 T4457 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1973505 T4457 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369452807235/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3/
[junit4:junit4] 2> 1973506 T4457 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d671e3c
[junit4:junit4] 2> 1973506 T4457 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1973507 T4457 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3
[junit4:junit4] 2> 1973507 T4457 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3/index/
[junit4:junit4] 2> 1973508 T4457 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1973509 T4457 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3/index
[junit4:junit4] 2> 1973520 T4457 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@12142b54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66ea3bf2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1973521 T4457 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1973534 T4457 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1973534 T4457 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1973535 T4457 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1973536 T4457 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1973537 T4457 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1973537 T4457 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1973537 T4457 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1973538 T4457 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1973539 T4457 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1973557 T4457 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1973565 T4457 oass.SolrIndexSearcher.<init> Opening Searcher@58c68700 main
[junit4:junit4] 2> 1973566 T4457 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3/tlog
[junit4:junit4] 2> 1973567 T4457 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1973567 T4457 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1973572 T4458 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@58c68700 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1973574 T4457 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1973574 T4457 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1974074 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1974075 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52586_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52586"}
[junit4:junit4] 2> 1974076 T4405 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1974076 T4405 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1974094 T4456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1974094 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1974094 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1974094 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1974094 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1974578 T4457 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1974578 T4457 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52586 collection:collection1 shard:shard1
[junit4:junit4] 2> 1974586 T4457 oasc.ZkController.register We are http://127.0.0.1:52586/collection1/ and leader is http://127.0.0.1:45547/collection1/
[junit4:junit4] 2> 1974586 T4457 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52586
[junit4:junit4] 2> 1974586 T4457 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1974587 T4457 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C3169 name=collection1 org.apache.solr.core.SolrCore@7a0f9b65 url=http://127.0.0.1:52586/collection1 node=127.0.0.1:52586_ C3169_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52586_, base_url=http://127.0.0.1:52586}
[junit4:junit4] 2> 1974587 T4459 C3169 P52586 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1974588 T4457 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1974588 T4459 C3169 P52586 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1974588 T4459 C3169 P52586 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1974589 T4459 C3169 P52586 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1974589 T4382 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1974590 T4382 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1974591 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1974592 T4459 C3169 P52586 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1974617 T4414 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52586__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1974899 T4382 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1974903 T4382 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:63994
[junit4:junit4] 2> 1974904 T4382 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1974904 T4382 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1974905 T4382 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369452810750
[junit4:junit4] 2> 1974905 T4382 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369452810750/solr.xml
[junit4:junit4] 2> 1974906 T4382 oasc.CoreContainer.<init> New CoreContainer 255008102
[junit4:junit4] 2> 1974907 T4382 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369452810750/'
[junit4:junit4] 2> 1974907 T4382 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369452810750/'
[junit4:junit4] 2> 1975039 T4382 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1975040 T4382 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1975041 T4382 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1975041 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1975042 T4382 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1975042 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1975043 T4382 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1975044 T4382 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1975044 T4382 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1975045 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1975062 T4382 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1975063 T4382 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58596/solr
[junit4:junit4] 2> 1975063 T4382 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1975065 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1975067 T4471 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46aa646a name:ZooKeeperConnection Watcher:127.0.0.1:58596 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1975068 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1975070 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1975083 T4382 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1975085 T4473 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1251b5f name:ZooKeeperConnection Watcher:127.0.0.1:58596/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1975085 T4382 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1975099 T4382 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1975599 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1975600 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52586__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52586_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52586"}
[junit4:junit4] 2> 1975701 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1975701 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1975701 T4456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1975701 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1975701 T4473 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1975701 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1976102 T4382 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63994_
[junit4:junit4] 2> 1976104 T4382 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63994_
[junit4:junit4] 2> 1976107 T4456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1976107 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1976108 T4424 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1976108 T4473 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1976108 T4411 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1976107 T4404 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1976109 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1976108 T4473 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1976108 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1976109 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1976128 T4456 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1976128 T4440 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1976134 T4474 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369452810750/collection1
[junit4:junit4] 2> 1976134 T4474 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1976135 T4474 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1976135 T4474 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1976137 T4474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369452810750/collection1/'
[junit4:junit4] 2> 1976138 T4474 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1369452810750/collection1/lib/README' to classloader
[junit4:junit4] 2> 1976139 T4474 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1369452810750/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1976194 T4474 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1976255 T4474 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1976357 T4474 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1976371 T4474 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1976620 T4414 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52586__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1976620 T4414 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52586__collection1&state=recovering&nodeName=127.0.0.1:52586_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 1977006 T4474 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1977011 T4474 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1977014 T4474 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1977020 T4474 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1977056 T4474 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1977057 T4474 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369452810750/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/
[junit4:junit4] 2> 1977057 T4474 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2d671e3c
[junit4:junit4] 2> 1977058 T4474 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1977059 T4474 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4
[junit4:junit4] 2> 1977059 T4474 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index/
[junit4:junit4] 2> 1977059 T4474 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1977061 T4474 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index
[junit4:junit4] 2> 1977075 T4474 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@67808e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7101ba),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1977075 T4474 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1977093 T4474 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1977094 T4474 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1977094 T4474 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1977095 T4474 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1977096 T4474 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1977096 T4474 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1977097 T4474 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1977097 T4474 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1977098 T4474 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1977116 T4474 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1977124 T4474 oass.SolrIndexSearcher.<init> Opening Searcher@4f27c440 main
[junit4:junit4] 2> 1977124 T4474 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/tlog
[junit4:junit4] 2> 1977126 T4474 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1977126 T4474 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1977131 T4475 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f27c440 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1977133 T4474 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1977134 T4474 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1977210 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1977211 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63994_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63994"}
[junit4:junit4] 2> 1977211 T4405 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1977212 T4405 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1977235 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1977235 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1977235 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1977235 T4456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1977235 T4473 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1977235 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1978158 T4474 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1978158 T4474 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:63994 collection:collection1 shard:shard2
[junit4:junit4] 2> 1978166 T4474 oasc.ZkController.register We are http://127.0.0.1:63994/collection1/ and leader is http://127.0.0.1:29453/collection1/
[junit4:junit4] 2> 1978167 T4474 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63994
[junit4:junit4] 2> 1978167 T4474 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1978167 T4474 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C3170 name=collection1 org.apache.solr.core.SolrCore@40621c34 url=http://127.0.0.1:63994/collection1 node=127.0.0.1:63994_ C3170_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:63994_, base_url=http://127.0.0.1:63994}
[junit4:junit4] 2> 1978168 T4476 C3170 P63994 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1978168 T4474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1978168 T4476 C3170 P63994 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1978169 T4476 C3170 P63994 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1978169 T4476 C3170 P63994 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1978170 T4382 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1978170 T4382 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1978171 T4382 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1978188 T4476 C3170 P63994 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1978188 T4382 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1978190 T4382 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1978190 T4382 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1978191 T4382 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1978199 T4430 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:63994__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> ASYNC NEW_CORE C3171 name=collection1 org.apache.solr.core.SolrCore@7a0f9b65 url=http://127.0.0.1:52586/collection1 node=127.0.0.1:52586_ C3171_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52586_, base_url=http://127.0.0.1:52586}
[junit4:junit4] 2> 1978622 T4459 C3171 P52586 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:45547/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1978622 T4459 C3171 P52586 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52586 START replicas=[http://127.0.0.1:45547/collection1/] nUpdates=100
[junit4:junit4] 2> 1978623 T4459 C3171 P52586 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1978624 T4459 C3171 P52586 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1978624 T4459 C3171 P52586 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1978625 T4459 C3171 P52586 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1978625 T4459 C3171 P52586 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1978625 T4459 C3171 P52586 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:45547/collection1/. core=collection1
[junit4:junit4] 2> 1978625 T4459 C3171 P52586 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C3172 name=collection1 org.apache.solr.core.SolrCore@3255e846 url=http://127.0.0.1:45547/collection1 node=127.0.0.1:45547_ C3172_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:45547_, base_url=http://127.0.0.1:45547, leader=true}
[junit4:junit4] 2> 1978633 T4415 C3172 P45547 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1978637 T4416 C3172 P45547 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1978673 T4416 C3172 P45547 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f0f057a lockFactory=org.apache.lucene.store.NativeFSLockFactory@15c52c2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1978674 T4416 C3172 P45547 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1978675 T4416 C3172 P45547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f0f057a lockFactory=org.apache.lucene.store.NativeFSLockFactory@15c52c2),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f0f057a lockFactory=org.apache.lucene.store.NativeFSLockFactory@15c52c2),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1978675 T4416 C3172 P45547 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1978676 T4416 C3172 P45547 oass.SolrIndexSearcher.<init> Opening Searcher@29b06b20 realtime
[junit4:junit4] 2> 1978676 T4416 C3172 P45547 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1978677 T4416 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 40
[junit4:junit4] 2> 1978678 T4459 C3171 P52586 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1978679 T4459 C3171 P52586 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1978681 T4417 C3172 P45547 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1978681 T4417 C3172 P45547 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1978682 T4459 C3171 P52586 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1978682 T4459 C3171 P52586 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1978683 T4459 C3171 P52586 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1978685 T4417 C3172 P45547 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1978686 T4459 C3171 P52586 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1978687 T4459 C3171 P52586 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3/index.20130525093334821
[junit4:junit4] 2> 1978687 T4459 C3171 P52586 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@40bb8a9a lockFactory=org.apache.lucene.store.NativeFSLockFactory@65178007) fullCopy=false
[junit4:junit4] 2> 1978690 T4417 C3172 P45547 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1978691 T4459 C3171 P52586 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1978692 T4459 C3171 P52586 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1978692 T4459 C3171 P52586 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1978715 T4459 C3171 P52586 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@12142b54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66ea3bf2),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@12142b54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66ea3bf2),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1978716 T4459 C3171 P52586 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1978716 T4459 C3171 P52586 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1978717 T4459 C3171 P52586 oass.SolrIndexSearcher.<init> Opening Searcher@7bb7b8aa main
[junit4:junit4] 2> 1978718 T4458 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7bb7b8aa main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1978719 T4459 C3171 P52586 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3/index.20130525093334821 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3/index.20130525093334821;done=true>>]
[junit4:junit4] 2> 1978719 T4459 C3171 P52586 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3/index.20130525093334821
[junit4:junit4] 2> 1978719 T4459 C3171 P52586 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty3/index.20130525093334821
[junit4:junit4] 2> 1978720 T4459 C3171 P52586 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1978720 T4459 C3171 P52586 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1978720 T4459 C3171 P52586 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1978720 T4459 C3171 P52586 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1978722 T4459 C3171 P52586 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1978739 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1978740 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:63994__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63994_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63994"}
[junit4:junit4] 2> 1978796 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52586__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52586_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52586"}
[junit4:junit4] 2> 1978899 T4456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1978899 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1978899 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1978899 T4473 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1978899 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1978899 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1979193 T4382 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1979200 T4430 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:63994__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1979200 T4430 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:63994__collection1&state=recovering&nodeName=127.0.0.1:63994_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 1980196 T4382 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1981199 T4382 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C3170_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:63994_, base_url=http://127.0.0.1:63994}
[junit4:junit4] 2> 1981202 T4476 C3170 P63994 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:29453/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1981202 T4476 C3170 P63994 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:63994 START replicas=[http://127.0.0.1:29453/collection1/] nUpdates=100
[junit4:junit4] 2> 1981203 T4476 C3170 P63994 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1981203 T4476 C3170 P63994 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1981203 T4476 C3170 P63994 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1981203 T4476 C3170 P63994 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1981204 T4476 C3170 P63994 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1981204 T4476 C3170 P63994 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:29453/collection1/. core=collection1
[junit4:junit4] 2> 1981204 T4476 C3170 P63994 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C3173 name=collection1 org.apache.solr.core.SolrCore@2008eef8 url=http://127.0.0.1:29453/collection1 node=127.0.0.1:29453_ C3173_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:29453_, base_url=http://127.0.0.1:29453, leader=true}
[junit4:junit4] 2> 1981211 T4431 C3173 P29453 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1981215 T4432 C3173 P29453 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1981239 T4432 C3173 P29453 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42db251a lockFactory=org.apache.lucene.store.NativeFSLockFactory@60ca3674),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1981240 T4432 C3173 P29453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1981241 T4432 C3173 P29453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42db251a lockFactory=org.apache.lucene.store.NativeFSLockFactory@60ca3674),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42db251a lockFactory=org.apache.lucene.store.NativeFSLockFactory@60ca3674),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1981242 T4432 C3173 P29453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1981242 T4432 C3173 P29453 oass.SolrIndexSearcher.<init> Opening Searcher@54cc91f3 realtime
[junit4:junit4] 2> 1981243 T4432 C3173 P29453 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1981243 T4432 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 28
[junit4:junit4] 2> 1981244 T4476 C3170 P63994 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1981244 T4476 C3170 P63994 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1981246 T4433 C3173 P29453 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1981247 T4433 C3173 P29453 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1981247 T4476 C3170 P63994 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1981248 T4476 C3170 P63994 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1981248 T4476 C3170 P63994 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1981250 T4433 C3173 P29453 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1981251 T4476 C3170 P63994 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1981252 T4476 C3170 P63994 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index.20130525093337386
[junit4:junit4] 2> 1981252 T4476 C3170 P63994 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@65e3e4d lockFactory=org.apache.lucene.store.NativeFSLockFactory@25995d55) fullCopy=false
[junit4:junit4] 2> 1981255 T4433 C3173 P29453 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1981256 T4476 C3170 P63994 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1981257 T4476 C3170 P63994 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1981257 T4476 C3170 P63994 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1981275 T4476 C3170 P63994 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@67808e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7101ba),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@67808e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7101ba),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1981276 T4476 C3170 P63994 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1981276 T4476 C3170 P63994 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1981277 T4476 C3170 P63994 oass.SolrIndexSearcher.<init> Opening Searcher@1964e0f2 main
[junit4:junit4] 2> 1981278 T4475 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1964e0f2 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1981279 T4476 C3170 P63994 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index.20130525093337386 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index.20130525093337386;done=true>>]
[junit4:junit4] 2> 1981279 T4476 C3170 P63994 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index.20130525093337386
[junit4:junit4] 2> 1981279 T4476 C3170 P63994 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index.20130525093337386
[junit4:junit4] 2> 1981280 T4476 C3170 P63994 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1981280 T4476 C3170 P63994 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1981280 T4476 C3170 P63994 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1981280 T4476 C3170 P63994 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1981283 T4476 C3170 P63994 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1981943 T4405 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1981944 T4405 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:63994__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63994_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63994"}
[junit4:junit4] 2> 1981966 T4404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1981966 T4424 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1981966 T4411 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1981966 T4473 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1981966 T4440 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1981966 T4456 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1982202 T4382 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1982203 T4382 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C3174 name=collection1 org.apache.solr.core.SolrCore@6938ebd7 url=http://127.0.0.1:32866/collection1 node=127.0.0.1:32866_ C3174_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:32866_, base_url=http://127.0.0.1:32866, leader=true}
[junit4:junit4] 2> 1982212 T4394 C3174 P32866 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1982236 T4394 C3174 P32866 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f616c13 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5bc159a3),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1982237 T4394 C3174 P32866 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1982238 T4394 C3174 P32866 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f616c13 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5bc159a3),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f616c13 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5bc159a3),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1982239 T4394 C3174 P32866 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1982239 T4394 C3174 P32866 oass.SolrIndexSearcher.<init> Opening Searcher@29fe5969 main
[junit4:junit4] 2> 1982240 T4394 C3174 P32866 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1982241 T4408 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@29fe5969 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1982241 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 29
[junit4:junit4] 2> 1982254 T4434 C3173 P29453 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1982255 T4434 C3173 P29453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42db251a lockFactory=org.apache.lucene.store.NativeFSLockFactory@60ca3674),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42db251a lockFactory=org.apache.lucene.store.NativeFSLockFactory@60ca3674),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1982255 T4434 C3173 P29453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1982256 T4434 C3173 P29453 oass.SolrIndexSearcher.<init> Opening Searcher@481274a main
[junit4:junit4] 2> 1982256 T4434 C3173 P29453 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1982257 T4442 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@481274a main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1982258 T4434 C3173 P29453 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:45547/collection1/, StdNode: http://127.0.0.1:52586/collection1/, StdNode: http://127.0.0.1:63994/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1982261 T4418 C3172 P45547 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1982262 T4418 C3172 P45547 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f0f057a lockFactory=org.apache.lucene.store.NativeFSLockFactory@15c52c2),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f0f057a lockFactory=org.apache.lucene.store.NativeFSLockFactory@15c52c2),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1982263 T4418 C3172 P45547 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1982263 T4418 C3172 P45547 oass.SolrIndexSearcher.<init> Opening Searcher@2495b709 main
[junit4:junit4] 2> 1982264 T4418 C3172 P45547 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1982265 T4426 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2495b709 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1982266 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C3170_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:63994_, base_url=http://127.0.0.1:63994}
[junit4:junit4] 2> 1982269 T4463 C3170 P63994 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C3171_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52586_, base_url=http://127.0.0.1:52586}
[junit4:junit4] 2> 1982269 T4446 C3171 P52586 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1982270 T4463 C3170 P63994 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@67808e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7101ba),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@67808e1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f7101ba),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1982271 T4446 C3171 P52586 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@12142b54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66ea3bf2),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@12142b54 lockFactory=org.apache.lucene.store.NativeFSLockFactory@66ea3bf2),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1982271 T4463 C3170 P63994 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1982272 T4446 C3171 P52586 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1982272 T4463 C3170 P63994 oass.SolrIndexSearcher.<init> Opening Searcher@6c2ea710 main
[junit4:junit4] 2> 1982273 T4446 C3171 P52586 oass.SolrIndexSearcher.<init> Opening Searcher@49f896a5 main
[junit4:junit4] 2> 1982274 T4463 C3170 P63994 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1982274 T4475 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c2ea710 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1982275 T4458 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49f896a5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1982274 T4446 C3171 P52586 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1982275 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 1982276 T4446 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1982277 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 23
[junit4:junit4] 2> 1982278 T4382 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1982281 T4419 C3172 P45547 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1982283 T4447 C3171 P52586 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1982285 T4435 C3173 P29453 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1982286 T4464 C3170 P63994 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1984316 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435975360631013376)} 0 26
[junit4:junit4] 2> 1984440 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435975360659324928&update.from=http://127.0.0.1:45547/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435975360659324928)} 0 106
[junit4:junit4] 2> 1984453 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435975360676102144&update.from=http://127.0.0.1:29453/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435975360676102144)} 0 11
[junit4:junit4] 2> 1984454 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435975360676102144)} 0 120
[junit4:junit4] 2> 1984455 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435975360659324928)} 0 137
[junit4:junit4] 2> 1984459 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1435975360806125568)]} 0 1
[junit4:junit4] 2> 1984466 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435975360811368448)]} 0 0
[junit4:junit4] 2> 1984467 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1435975360811368448)]} 0 4
[junit4:junit4] 2> 1984468 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0]} 0 7
[junit4:junit4] 2> 1984471 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435975360819757056)]} 0 0
[junit4:junit4] 2> 1984477 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435975360822902784)]} 0 0
[junit4:junit4] 2> 1984478 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435975360822902784)]} 0 4
[junit4:junit4] 2> 1984481 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435975360830242816)]} 0 0
[junit4:junit4] 2> 1984486 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435975360833388544)]} 0 0
[junit4:junit4] 2> 1984487 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435975360833388544)]} 0 3
[junit4:junit4] 2> 1984490 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435975360839680000)]} 0 0
[junit4:junit4] 2> 1984497 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435975360844922880)]} 0 0
[junit4:junit4] 2> 1984498 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!3 (1435975360844922880)]} 0 3
[junit4:junit4] 2> 1984499 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3]} 0 6
[junit4:junit4] 2> 1984501 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435975360851214336)]} 0 0
[junit4:junit4] 2> 1984508 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435975360856457216)]} 0 0
[junit4:junit4] 2> 1984509 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1435975360856457216)]} 0 3
[junit4:junit4] 2> 1984510 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4]} 0 6
[junit4:junit4] 2> 1984513 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435975360863797248)]} 0 0
[junit4:junit4] 2> 1984520 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435975360869040128)]} 0 0
[junit4:junit4] 2> 1984521 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1435975360869040128)]} 0 3
[junit4:junit4] 2> 1984522 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5]} 0 6
[junit4:junit4] 2> 1984524 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1435975360875331584)]} 0 0
[junit4:junit4] 2> 1984530 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435975360878477312)]} 0 0
[junit4:junit4] 2> 1984531 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1435975360878477312)]} 0 4
[junit4:junit4] 2> 1984534 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435975360885817344)]} 0 0
[junit4:junit4] 2> 1984542 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435975360891060224)]} 0 0
[junit4:junit4] 2> 1984543 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1435975360891060224)]} 0 4
[junit4:junit4] 2> 1984544 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7]} 0 7
[junit4:junit4] 2> 1984547 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435975360899448832)]} 0 0
[junit4:junit4] 2> 1984555 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435975360904691712)]} 0 0
[junit4:junit4] 2> 1984556 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!8 (1435975360904691712)]} 0 4
[junit4:junit4] 2> 1984557 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8]} 0 7
[junit4:junit4] 2> 1984560 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435975360913080320)]} 0 0
[junit4:junit4] 2> 1984567 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435975360918323200)]} 0 0
[junit4:junit4] 2> 1984568 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!9 (1435975360918323200)]} 0 3
[junit4:junit4] 2> 1984569 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9]} 0 6
[junit4:junit4] 2> 1984572 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1435975360925663232)]} 0 0
[junit4:junit4] 2> 1984579 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435975360930906112)]} 0 0
[junit4:junit4] 2> 1984580 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1435975360930906112)]} 0 3
[junit4:junit4] 2> 1984581 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10]} 0 6
[junit4:junit4] 2> 1984584 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435975360938246144)]} 0 0
[junit4:junit4] 2> 1984589 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435975360941391872)]} 0 0
[junit4:junit4] 2> 1984590 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435975360941391872)]} 0 3
[junit4:junit4] 2> 1984593 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435975360947683328)]} 0 0
[junit4:junit4] 2> 1984601 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435975360952926208)]} 0 0
[junit4:junit4] 2> 1984602 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1435975360952926208)]} 0 4
[junit4:junit4] 2> 1984603 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12]} 0 7
[junit4:junit4] 2> 1984606 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435975360961314816)]} 0 0
[junit4:junit4] 2> 1984611 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435975360964460544)]} 0 0
[junit4:junit4] 2> 1984612 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435975360964460544)]} 0 3
[junit4:junit4] 2> 1984615 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435975360970752000)]} 0 0
[junit4:junit4] 2> 1984622 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435975360975994880)]} 0 0
[junit4:junit4] 2> 1984623 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!14 (1435975360975994880)]} 0 3
[junit4:junit4] 2> 1984624 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14]} 0 6
[junit4:junit4] 2> 1984626 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435975360982286336)]} 0 0
[junit4:junit4] 2> 1984631 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435975360985432064)]} 0 0
[junit4:junit4] 2> 1984632 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435975360985432064)]} 0 3
[junit4:junit4] 2> 1984635 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435975360991723520)]} 0 0
[junit4:junit4] 2> 1984642 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435975360996966400)]} 0 0
[junit4:junit4] 2> 1984643 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1435975360996966400)]} 0 3
[junit4:junit4] 2> 1984644 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16]} 0 6
[junit4:junit4] 2> 1984646 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435975361003257856)]} 0 0
[junit4:junit4] 2> 1984651 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435975361006403584)]} 0 0
[junit4:junit4] 2> 1984652 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435975361006403584)]} 0 3
[junit4:junit4] 2> 1984655 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1435975361012695040)]} 0 0
[junit4:junit4] 2> 1984662 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435975361017937920)]} 0 0
[junit4:junit4] 2> 1984663 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1435975361017937920)]} 0 3
[junit4:junit4] 2> 1984664 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18]} 0 6
[junit4:junit4] 2> 1984666 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435975361024229376)]} 0 0
[junit4:junit4] 2> 1984673 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435975361029472256)]} 0 0
[junit4:junit4] 2> 1984674 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!19 (1435975361029472256)]} 0 3
[junit4:junit4] 2> 1984675 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19]} 0 6
[junit4:junit4] 2> 1984677 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1435975361035763712)]} 0 0
[junit4:junit4] 2> 1984684 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435975361041006592)]} 0 0
[junit4:junit4] 2> 1984685 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1435975361041006592)]} 0 3
[junit4:junit4] 2> 1984686 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 6
[junit4:junit4] 2> 1984688 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435975361047298048)]} 0 0
[junit4:junit4] 2> 1984693 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435975361050443776)]} 0 0
[junit4:junit4] 2> 1984694 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435975361050443776)]} 0 3
[junit4:junit4] 2> 1984697 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435975361056735232)]} 0 0
[junit4:junit4] 2> 1984702 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435975361059880960)]} 0 0
[junit4:junit4] 2> 1984703 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435975361059880960)]} 0 3
[junit4:junit4] 2> 1984706 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435975361066172416)]} 0 0
[junit4:junit4] 2> 1984714 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435975361071415296)]} 0 0
[junit4:junit4] 2> 1984715 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1435975361071415296)]} 0 4
[junit4:junit4] 2> 1984716 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23]} 0 7
[junit4:junit4] 2> 1984719 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1435975361079803904)]} 0 0
[junit4:junit4] 2> 1984727 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435975361085046784)]} 0 0
[junit4:junit4] 2> 1984729 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1435975361085046784)]} 0 5
[junit4:junit4] 2> 1984729 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24]} 0 7
[junit4:junit4] 2> 1984732 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435975361093435392)]} 0 0
[junit4:junit4] 2> 1984738 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435975361096581120)]} 0 0
[junit4:junit4] 2> 1984739 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435975361096581120)]} 0 4
[junit4:junit4] 2> 1984743 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435975361104969728)]} 0 0
[junit4:junit4] 2> 1984749 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435975361108115456)]} 0 0
[junit4:junit4] 2> 1984751 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435975361108115456)]} 0 5
[junit4:junit4] 2> 1984753 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1435975361115455488)]} 0 0
[junit4:junit4] 2> 1984761 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435975361120698368)]} 0 0
[junit4:junit4] 2> 1984762 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1435975361120698368)]} 0 4
[junit4:junit4] 2> 1984763 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 7
[junit4:junit4] 2> 1984766 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435975361129086976)]} 0 0
[junit4:junit4] 2> 1984772 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435975361132232704)]} 0 0
[junit4:junit4] 2> 1984773 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435975361132232704)]} 0 4
[junit4:junit4] 2> 1984776 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1435975361139572736)]} 0 0
[junit4:junit4] 2> 1984784 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435975361144815616)]} 0 0
[junit4:junit4] 2> 1984785 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1435975361144815616)]} 0 4
[junit4:junit4] 2> 1984786 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29]} 0 7
[junit4:junit4] 2> 1984789 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435975361153204224)]} 0 0
[junit4:junit4] 2> 1984796 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435975361158447104)]} 0 0
[junit4:junit4] 2> 1984797 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!30 (1435975361158447104)]} 0 3
[junit4:junit4] 2> 1984798 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30]} 0 6
[junit4:junit4] 2> 1984801 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435975361165787136)]} 0 0
[junit4:junit4] 2> 1984808 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435975361171030016)]} 0 0
[junit4:junit4] 2> 1984809 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1435975361171030016)]} 0 3
[junit4:junit4] 2> 1984810 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31]} 0 6
[junit4:junit4] 2> 1984813 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435975361178370048)]} 0 0
[junit4:junit4] 2> 1984818 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435975361181515776)]} 0 0
[junit4:junit4] 2> 1984819 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435975361181515776)]} 0 3
[junit4:junit4] 2> 1984822 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1435975361187807232)]} 0 0
[junit4:junit4] 2> 1984830 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435975361194098688)]} 0 0
[junit4:junit4] 2> 1984831 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1435975361194098688)]} 0 3
[junit4:junit4] 2> 1984832 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33]} 0 6
[junit4:junit4] 2> 1984835 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435975361201438720)]} 0 0
[junit4:junit4] 2> 1984840 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435975361204584448)]} 0 0
[junit4:junit4] 2> 1984841 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435975361204584448)]} 0 3
[junit4:junit4] 2> 1984844 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435975361210875904)]} 0 0
[junit4:junit4] 2> 1984851 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435975361216118784)]} 0 0
[junit4:junit4] 2> 1984852 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!35 (1435975361216118784)]} 0 3
[junit4:junit4] 2> 1984853 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35]} 0 6
[junit4:junit4] 2> 1984856 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435975361223458816)]} 0 0
[junit4:junit4] 2> 1984863 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1435975361228701696)]} 0 0
[junit4:junit4] 2> 1984864 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1435975361228701696)]} 0 3
[junit4:junit4] 2> 1984865 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36]} 0 6
[junit4:junit4] 2> 1984868 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1435975361236041728)]} 0 0
[junit4:junit4] 2> 1984876 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1435975361241284608)]} 0 0
[junit4:junit4] 2> 1984877 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1435975361241284608)]} 0 4
[junit4:junit4] 2> 1984878 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37]} 0 7
[junit4:junit4] 2> 1984881 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435975361249673216)]} 0 0
[junit4:junit4] 2> 1984886 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1435975361252818944)]} 0 0
[junit4:junit4] 2> 1984887 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435975361252818944)]} 0 3
[junit4:junit4] 2> 1984890 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1435975361259110400)]} 0 0
[junit4:junit4] 2> 1984895 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1435975361262256128)]} 0 0
[junit4:junit4] 2> 1984896 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1435975361262256128)]} 0 3
[junit4:junit4] 2> 1984899 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435975361268547584)]} 0 0
[junit4:junit4] 2> 1984907 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1435975361273790464)]} 0 1
[junit4:junit4] 2> 1984907 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1435975361273790464)]} 0 3
[junit4:junit4] 2> 1984908 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40]} 0 6
[junit4:junit4] 2> 1984911 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1435975361281130496)]} 0 0
[junit4:junit4] 2> 1984918 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1435975361286373376)]} 0 0
[junit4:junit4] 2> 1984919 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!41 (1435975361286373376)]} 0 3
[junit4:junit4] 2> 1984920 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41]} 0 6
[junit4:junit4] 2> 1984923 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435975361293713408)]} 0 0
[junit4:junit4] 2> 1984928 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1435975361296859136)]} 0 0
[junit4:junit4] 2> 1984929 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435975361296859136)]} 0 3
[junit4:junit4] 2> 1984933 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435975361303150592)]} 0 1
[junit4:junit4] 2> 1984939 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1435975361307344896)]} 0 0
[junit4:junit4] 2> 1984940 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435975361307344896)]} 0 4
[junit4:junit4] 2> 1984943 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435975361314684928)]} 0 0
[junit4:junit4] 2> 1984948 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1435975361317830656)]} 0 0
[junit4:junit4] 2> 1984949 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435975361317830656)]} 0 3
[junit4:junit4] 2> 1984952 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435975361324122112)]} 0 0
[junit4:junit4] 2> 1984959 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1435975361329364992)]} 0 0
[junit4:junit4] 2> 1984960 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!45 (1435975361329364992)]} 0 3
[junit4:junit4] 2> 1984961 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45]} 0 6
[junit4:junit4] 2> 1984964 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435975361336705024)]} 0 1
[junit4:junit4] 2> 1984971 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1435975361341947904)]} 0 0
[junit4:junit4] 2> 1984972 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!46 (1435975361341947904)]} 0 3
[junit4:junit4] 2> 1984973 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46]} 0 6
[junit4:junit4] 2> 1984976 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1435975361349287936)]} 0 0
[junit4:junit4] 2> 1984983 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1435975361354530816)]} 0 0
[junit4:junit4] 2> 1984984 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1435975361354530816)]} 0 3
[junit4:junit4] 2> 1984985 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 6
[junit4:junit4] 2> 1984988 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435975361361870848)]} 0 0
[junit4:junit4] 2> 1984994 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1435975361366065152)]} 0 0
[junit4:junit4] 2> 1984995 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435975361366065152)]} 0 3
[junit4:junit4] 2> 1984998 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1435975361372356608)]} 0 0
[junit4:junit4] 2> 1985006 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1435975361377599488)]} 0 0
[junit4:junit4] 2> 1985008 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1435975361377599488)]} 0 5
[junit4:junit4] 2> 1985009 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49]} 0 8
[junit4:junit4] 2> 1985011 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435975361385988096)]} 0 0
[junit4:junit4] 2> 1985017 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1435975361389133824)]} 0 0
[junit4:junit4] 2> 1985018 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435975361389133824)]} 0 4
[junit4:junit4] 2> 1985021 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435975361396473856)]} 0 0
[junit4:junit4] 2> 1985027 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1435975361399619584)]} 0 0
[junit4:junit4] 2> 1985029 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435975361399619584)]} 0 5
[junit4:junit4] 2> 1985031 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435975361406959616)]} 0 0
[junit4:junit4] 2> 1985036 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1435975361410105344)]} 0 0
[junit4:junit4] 2> 1985037 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435975361410105344)]} 0 3
[junit4:junit4] 2> 1985040 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435975361416396800)]} 0 0
[junit4:junit4] 2> 1985045 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1435975361419542528)]} 0 0
[junit4:junit4] 2> 1985046 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435975361419542528)]} 0 3
[junit4:junit4] 2> 1985050 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435975361425833984)]} 0 1
[junit4:junit4] 2> 1985058 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1435975361432125440)]} 0 0
[junit4:junit4] 2> 1985059 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!54 (1435975361432125440)]} 0 4
[junit4:junit4] 2> 1985060 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54]} 0 7
[junit4:junit4] 2> 1985063 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435975361440514048)]} 0 0
[junit4:junit4] 2> 1985070 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1435975361445756928)]} 0 0
[junit4:junit4] 2> 1985071 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1435975361445756928)]} 0 3
[junit4:junit4] 2> 1985072 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55]} 0 6
[junit4:junit4] 2> 1985074 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1435975361452048384)]} 0 0
[junit4:junit4] 2> 1985081 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1435975361457291264)]} 0 0
[junit4:junit4] 2> 1985082 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1435975361457291264)]} 0 3
[junit4:junit4] 2> 1985083 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 6
[junit4:junit4] 2> 1985085 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435975361463582720)]} 0 0
[junit4:junit4] 2> 1985091 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1435975361466728448)]} 0 0
[junit4:junit4] 2> 1985092 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435975361466728448)]} 0 4
[junit4:junit4] 2> 1985095 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435975361474068480)]} 0 0
[junit4:junit4] 2> 1985102 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1435975361479311360)]} 0 0
[junit4:junit4] 2> 1985103 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1435975361479311360)]} 0 3
[junit4:junit4] 2> 1985104 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58]} 0 6
[junit4:junit4] 2> 1985107 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435975361486651392)]} 0 0
[junit4:junit4] 2> 1985114 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1435975361491894272)]} 0 0
[junit4:junit4] 2> 1985115 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!59 (1435975361491894272)]} 0 3
[junit4:junit4] 2> 1985116 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59]} 0 6
[junit4:junit4] 2> 1985119 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1435975361499234304)]} 0 0
[junit4:junit4] 2> 1985127 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1435975361504477184)]} 0 0
[junit4:junit4] 2> 1985128 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1435975361504477184)]} 0 4
[junit4:junit4] 2> 1985129 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60]} 0 7
[junit4:junit4] 2> 1985132 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435975361512865792)]} 0 0
[junit4:junit4] 2> 1985137 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1435975361516011520)]} 0 0
[junit4:junit4] 2> 1985138 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435975361516011520)]} 0 3
[junit4:junit4] 2> 1985141 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435975361522302976)]} 0 0
[junit4:junit4] 2> 1985146 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1435975361525448704)]} 0 0
[junit4:junit4] 2> 1985147 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435975361525448704)]} 0 3
[junit4:junit4] 2> 1985150 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1435975361531740160)]} 0 0
[junit4:junit4] 2> 1985155 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1435975361534885888)]} 0 0
[junit4:junit4] 2> 1985156 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1435975361534885888)]} 0 3
[junit4:junit4] 2> 1985159 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1435975361541177344)]} 0 0
[junit4:junit4] 2> 1985168 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1435975361546420224)]} 0 1
[junit4:junit4] 2> 1985169 T4436 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!64 (1435975361546420224)]} 0 5
[junit4:junit4] 2> 1985169 T4420 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64]} 0 7
[junit4:junit4] 2> 1985172 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435975361554808832)]} 0 0
[junit4:junit4] 2> 1985180 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1435975361560051712)]} 0 0
[junit4:junit4] 2> 1985181 T4418 C3172 P45547 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!65 (1435975361560051712)]} 0 4
[junit4:junit4] 2> 1985182 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65]} 0 7
[junit4:junit4] 2> 1985185 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1435975361568440320)]} 0 0
[junit4:junit4] 2> 1985190 T4463 C3170 P63994 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:29453/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1435975361571586048)]} 0 0
[junit4:junit4] 2> 1985191 T4434 C3173 P29453 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1435975361571586048)]} 0 3
[junit4:junit4] 2> 1985194 T4394 C3174 P32866 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1435975361577877504)]} 0 0
[junit4:junit4] 2> 1985201 T4448 C3171 P52586 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:45547/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1435975361583120384)]} 0 0
[junit4:junit4] 2> 1985202 T4418 C3172 P45547 o
[...truncated too long message...]
lection1] Closing main searcher on request.
[junit4:junit4] 2> 2025099 T4473 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 2025099 T4473 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4;done=false>>]
[junit4:junit4] 2> 2025099 T4473 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4
[junit4:junit4] 2> 2025100 T4473 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index;done=false>>]
[junit4:junit4] 2> 2025100 T4473 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369452793669/jetty4/index
[junit4:junit4] 2> 2025100 T4473 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 2025101 T4473 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89748458286415884-127.0.0.1:63994__collection1-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 2025101 T4473 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2025102 T4473 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2025102 T4473 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2025102 T4473 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2025102 T4473 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2025103 T4473 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=pt_BR, timezone=Asia/Thimphu
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=237095088,total=524288000
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestFiltering, TestDynamicFieldResource, RequiredFieldsTest, NoCacheHeaderTest, FieldAnalysisRequestHandlerTest, URLClassifyProcessorTest, CurrencyFieldXmlFileTest, CachingDirectoryFactoryTest, TestLMJelinekMercerSimilarityFactory, TestAddFieldRealTimeGet, TestFieldTypeResource, TestLazyCores, TestSolrXml, DisMaxRequestHandlerTest, TestCodecSupport, TestRTGBase, TestUtils, TestComponentsName, TestCollationField, ChaosMonkeySafeLeaderTest, TestAnalyzedSuggestions, TestArbitraryIndexDir, OpenCloseCoreStressTest, TestDistributedSearch, OutputWriterTest, DistanceFunctionTest, SortByFunctionTest, TestSolr4Spatial, TestCopyFieldCollectionResource, TestJmxIntegration, TestBinaryResponseWriter, TestStressReorder, SuggesterWFSTTest, IndexReaderFactoryTest, TestCoreDiscovery, NotRequiredUniqueKeyTest, ZkNodePropsTest, CoreContainerCoreInitFailuresTest, TestSchemaNameResource, TestQuerySenderNoQuery, TimeZoneUtilsTest, TestDefaultSimilarityFactory, TestSolrXMLSerializer, SpellPossibilityIteratorTest, TestWordDelimiterFilterFactory, TestPropInject, TestBinaryField, TestDFRSimilarityFactory, SolrCmdDistributorTest, TestPartialUpdateDeduplication, BasicDistributedZk2Test, SolrTestCaseJ4Test, SimplePostToolTest, BadIndexSchemaTest, TestLuceneMatchVersion, TestDefaultSearchFieldResource, TestSchemaVersionResource, RequestHandlersTest, TestMultiCoreConfBootstrap, SolrPluginUtilsTest, TestRangeQuery, DocumentAnalysisRequestHandlerTest, TestSuggestSpellingConverter, TestSolrQueryParserDefaultOperatorResource, UniqFieldsUpdateProcessorFactoryTest, BasicZkTest, TestMergePolicyConfig, TestZkChroot, TestNumberUtils, LeaderElectionIntegrationTest, ShardRoutingCustomTest, CollectionsAPIDistributedZkTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, ZkSolrClientTest, TestRandomDVFaceting, TermVectorComponentDistributedTest, TestRealTimeGet, HardAutoCommitTest, DistributedTermsComponentTest, StatsComponentTest, SpellCheckComponentTest, QueryElevationComponentTest, TestSort, OverseerCollectionProcessorTest, TestIndexSearcher, ShowFileRequestHandlerTest, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, SuggesterTSTTest, TestStressLucene, SpatialFilterTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, FieldMutatingUpdateProcessorTest, QueryEqualityTest, DocValuesMultiTest, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, CacheHeaderTest, TestSurroundQueryParser, StandardRequestHandlerTest, TestQueryTypes, TestOmitPositions, XmlUpdateRequestHandlerTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, FastVectorHighlighterTest, ReturnFieldsTest, JSONWriterTest, JsonLoaderTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, HighlighterConfigTest, UpdateParamsTest, TestSolrIndexConfig, SolrIndexConfigTest, SampleTest, TestElisionMultitermQuery, TestSolrCoreProperties, TestCharFilters, TestXIncludeConfig, EchoParamsTest, TestIBSimilarityFactory, LegacyHTMLStripCharFilterTest, TestPluginEnable, OpenExchangeRatesOrgProviderTest, DateMathParserTest, TestSystemIdResolver, PrimUtilsTest, DateFieldTest, DOMUtilTest, TestSolrJ, ShardSplitTest]
[junit4:junit4] Completed on J1 in 67.62s, 1 test, 1 error <<< FAILURES!
[...truncated 17 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:380: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:360: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 error, 13 ignored (7 assumptions)
Total time: 54 minutes 51 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure