You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/05/27 23:36:48 UTC
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4021 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4021/
1 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:28467/cz_c/collection1lastClient and got 5 from http://127.0.0.1:28472/cz_c/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:28467/cz_c/collection1lastClient and got 5 from http://127.0.0.1:28472/cz_c/collection1
at __randomizedtesting.SeedInfo.seed([851C7082BAC15BEC:4FAFE9ACD9E3BD0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9596 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 417230 T873 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /cz_c/
[junit4:junit4] 2> 417234 T873 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1369688906844
[junit4:junit4] 2> 417236 T873 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 417236 T874 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 417337 T873 oasc.ZkTestServer.run start zk server on port:28440
[junit4:junit4] 2> 417338 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 417343 T880 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61e0db75 name:ZooKeeperConnection Watcher:127.0.0.1:28440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 417344 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 417344 T873 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 417360 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 417362 T882 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30fd1902 name:ZooKeeperConnection Watcher:127.0.0.1:28440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 417362 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 417363 T873 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 417374 T873 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 417377 T873 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 417380 T873 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 417388 T873 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 417389 T873 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 417402 T873 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 417402 T873 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 417506 T873 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 417507 T873 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 417510 T873 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 417511 T873 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 417514 T873 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 417514 T873 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 417518 T873 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 417518 T873 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 417527 T873 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 417528 T873 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 417531 T873 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 417531 T873 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 417535 T873 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 417535 T873 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 417712 T873 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 417715 T873 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28443
[junit4:junit4] 2> 417716 T873 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 417716 T873 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 417717 T873 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1369688907149
[junit4:junit4] 2> 417717 T873 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1369688907149/solr.xml
[junit4:junit4] 2> 417717 T873 oasc.CoreContainer.<init> New CoreContainer 571259826
[junit4:junit4] 2> 417718 T873 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1369688907149/'
[junit4:junit4] 2> 417718 T873 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1369688907149/'
[junit4:junit4] 2> 417802 T873 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 417803 T873 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 417803 T873 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 417804 T873 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 417804 T873 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 417805 T873 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 417805 T873 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 417805 T873 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 417806 T873 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 417806 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 417818 T873 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 417819 T873 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:28440/solr
[junit4:junit4] 2> 417819 T873 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 417820 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 417823 T893 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a87ae58 name:ZooKeeperConnection Watcher:127.0.0.1:28440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 417823 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 417832 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 417846 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 417847 T895 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35b7e51a name:ZooKeeperConnection Watcher:127.0.0.1:28440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 417848 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 417855 T873 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 417860 T873 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 417869 T873 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 417872 T873 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28443_cz_c
[junit4:junit4] 2> 417873 T873 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28443_cz_c
[junit4:junit4] 2> 417884 T873 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 417896 T873 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 417906 T873 oasc.Overseer.start Overseer (id=89763932199387139-127.0.0.1:28443_cz_c-n_0000000000) starting
[junit4:junit4] 2> 417916 T873 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 417928 T897 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 417928 T873 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 417931 T873 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 417933 T873 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 417936 T896 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 417939 T898 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1369688907149/collection1
[junit4:junit4] 2> 417939 T898 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 417940 T898 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 417940 T898 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 417942 T898 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1369688907149/collection1/'
[junit4:junit4] 2> 417943 T898 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1369688907149/collection1/lib/README' to classloader
[junit4:junit4] 2> 417944 T898 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1369688907149/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 417995 T898 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 418054 T898 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 418156 T898 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 418163 T898 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 418781 T898 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 418793 T898 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 418797 T898 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 418814 T898 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 418819 T898 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 418824 T898 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 418825 T898 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 418825 T898 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 418826 T898 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 418827 T898 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 418827 T898 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 418828 T898 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 418828 T898 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1369688907149/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/
[junit4:junit4] 2> 418828 T898 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@53b10504
[junit4:junit4] 2> 418829 T898 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 418830 T898 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data
[junit4:junit4] 2> 418831 T898 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index/
[junit4:junit4] 2> 418832 T898 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 418833 T898 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index
[junit4:junit4] 2> 418867 T898 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c766b5f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 418868 T898 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 418871 T898 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 418871 T898 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 418872 T898 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 418873 T898 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 418873 T898 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 418873 T898 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 418874 T898 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 418874 T898 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 418875 T898 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 418891 T898 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 418901 T898 oass.SolrIndexSearcher.<init> Opening Searcher@5525c74a main
[junit4:junit4] 2> 418902 T898 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 418903 T898 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 418906 T899 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5525c74a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 418908 T898 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 418908 T898 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 419440 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 419441 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28443_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28443/cz_c"}
[junit4:junit4] 2> 419441 T896 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 419441 T896 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 419454 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 419911 T898 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 419911 T898 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28443/cz_c collection:control_collection shard:shard1
[junit4:junit4] 2> 419912 T898 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 420081 T898 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 420118 T898 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 420118 T898 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 420119 T898 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:28443/cz_c/collection1/
[junit4:junit4] 2> 420119 T898 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 420119 T898 oasc.SyncStrategy.syncToMe http://127.0.0.1:28443/cz_c/collection1/ has no replicas
[junit4:junit4] 2> 420119 T898 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:28443/cz_c/collection1/
[junit4:junit4] 2> 420120 T898 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 420960 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 420985 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 421022 T898 oasc.ZkController.register We are http://127.0.0.1:28443/cz_c/collection1/ and leader is http://127.0.0.1:28443/cz_c/collection1/
[junit4:junit4] 2> 421022 T898 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28443/cz_c
[junit4:junit4] 2> 421022 T898 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 421023 T898 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 421023 T898 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 421026 T898 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 421027 T873 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 421028 T873 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 421028 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 421050 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 421052 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 421055 T902 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@94f634b name:ZooKeeperConnection Watcher:127.0.0.1:28440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 421055 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 421057 T873 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 421060 T873 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 421406 T873 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 421409 T873 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28453
[junit4:junit4] 2> 421411 T873 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 421411 T873 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 421412 T873 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1369688910670
[junit4:junit4] 2> 421412 T873 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1369688910670/solr.xml
[junit4:junit4] 2> 421413 T873 oasc.CoreContainer.<init> New CoreContainer 1019841172
[junit4:junit4] 2> 421414 T873 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1369688910670/'
[junit4:junit4] 2> 421414 T873 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1369688910670/'
[junit4:junit4] 2> 421577 T873 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 421578 T873 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 421578 T873 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 421579 T873 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 421579 T873 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 421580 T873 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 421580 T873 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 421581 T873 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 421581 T873 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 421582 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 421602 T873 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 421603 T873 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:28440/solr
[junit4:junit4] 2> 421603 T873 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 421605 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 421609 T913 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@209d1789 name:ZooKeeperConnection Watcher:127.0.0.1:28440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 421610 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 421626 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 421640 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 421642 T915 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@612243f4 name:ZooKeeperConnection Watcher:127.0.0.1:28440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 421643 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 421653 T873 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 422498 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 422499 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:28443_cz_c_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28443_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28443/cz_c"}
[junit4:junit4] 2> 422546 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 422546 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 422546 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 422658 T873 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28453_cz_c
[junit4:junit4] 2> 422686 T873 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28453_cz_c
[junit4:junit4] 2> 422689 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 422689 T895 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 422690 T902 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 422690 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 422690 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 422691 T915 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 422708 T916 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1369688910670/collection1
[junit4:junit4] 2> 422708 T916 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 422709 T916 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 422709 T916 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 422711 T916 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1369688910670/collection1/'
[junit4:junit4] 2> 422712 T916 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1369688910670/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 422713 T916 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1369688910670/collection1/lib/README' to classloader
[junit4:junit4] 2> 422778 T916 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 422839 T916 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 422940 T916 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 422947 T916 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 423517 T916 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 423526 T916 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 423528 T916 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 423543 T916 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 423547 T916 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 423563 T916 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 423565 T916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 423565 T916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 423565 T916 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 423566 T916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 423567 T916 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 423567 T916 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 423567 T916 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1369688910670/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/
[junit4:junit4] 2> 423567 T916 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@53b10504
[junit4:junit4] 2> 423568 T916 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 423569 T916 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1
[junit4:junit4] 2> 423569 T916 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index/
[junit4:junit4] 2> 423570 T916 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 423570 T916 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index
[junit4:junit4] 2> 423602 T916 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 423603 T916 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 423606 T916 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 423607 T916 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 423607 T916 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 423608 T916 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 423609 T916 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 423609 T916 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 423609 T916 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 423610 T916 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 423610 T916 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 423627 T916 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 423636 T916 oass.SolrIndexSearcher.<init> Opening Searcher@3b62e435 main
[junit4:junit4] 2> 423638 T916 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 423638 T916 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 423642 T917 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3b62e435 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 423644 T916 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 423644 T916 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 424053 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 424054 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28453_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28453/cz_c"}
[junit4:junit4] 2> 424054 T896 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 424054 T896 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 424068 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 424068 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 424068 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 424647 T916 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 424647 T916 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28453/cz_c collection:collection1 shard:shard1
[junit4:junit4] 2> 424648 T916 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 424666 T916 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 424678 T916 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 424678 T916 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 424679 T916 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:28453/cz_c/collection1/
[junit4:junit4] 2> 424679 T916 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 424679 T916 oasc.SyncStrategy.syncToMe http://127.0.0.1:28453/cz_c/collection1/ has no replicas
[junit4:junit4] 2> 424680 T916 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:28453/cz_c/collection1/
[junit4:junit4] 2> 424680 T916 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 425573 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 425582 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 425582 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 425582 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 425613 T916 oasc.ZkController.register We are http://127.0.0.1:28453/cz_c/collection1/ and leader is http://127.0.0.1:28453/cz_c/collection1/
[junit4:junit4] 2> 425613 T916 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28453/cz_c
[junit4:junit4] 2> 425613 T916 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 425613 T916 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 425614 T916 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 425617 T916 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 425618 T873 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 425619 T873 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 425620 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 425915 T873 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 425919 T873 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28462
[junit4:junit4] 2> 425919 T873 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 425920 T873 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 425921 T873 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1369688915246
[junit4:junit4] 2> 425921 T873 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1369688915246/solr.xml
[junit4:junit4] 2> 425922 T873 oasc.CoreContainer.<init> New CoreContainer 1517706244
[junit4:junit4] 2> 425922 T873 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1369688915246/'
[junit4:junit4] 2> 425923 T873 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1369688915246/'
[junit4:junit4] 2> 426058 T873 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 426059 T873 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 426059 T873 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 426060 T873 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 426060 T873 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 426061 T873 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 426061 T873 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 426062 T873 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 426062 T873 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 426063 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 426080 T873 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 426082 T873 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:28440/solr
[junit4:junit4] 2> 426082 T873 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 426083 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 426094 T929 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58d15a11 name:ZooKeeperConnection Watcher:127.0.0.1:28440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 426094 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 426098 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 426110 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 426112 T931 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e129c81 name:ZooKeeperConnection Watcher:127.0.0.1:28440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 426113 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 426122 T873 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 427089 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 427090 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:28453_cz_c_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28453_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28453/cz_c"}
[junit4:junit4] 2> 427130 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 427131 T873 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28462_cz_c
[junit4:junit4] 2> 427131 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 427130 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 427130 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 427133 T873 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28462_cz_c
[junit4:junit4] 2> 427144 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 427144 T931 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 427144 T902 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 427145 T895 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 427144 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 427145 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 427145 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 427146 T915 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 427152 T932 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1369688915246/collection1
[junit4:junit4] 2> 427153 T932 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 427153 T932 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 427154 T932 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 427155 T932 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1369688915246/collection1/'
[junit4:junit4] 2> 427157 T932 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1369688915246/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 427158 T932 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1369688915246/collection1/lib/README' to classloader
[junit4:junit4] 2> 427209 T932 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 427268 T932 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 427370 T932 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 427377 T932 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 427981 T932 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 427989 T932 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 427992 T932 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 428007 T932 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 428010 T932 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 428014 T932 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 428015 T932 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 428015 T932 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 428016 T932 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 428017 T932 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 428017 T932 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 428017 T932 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 428018 T932 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1369688915246/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/
[junit4:junit4] 2> 428018 T932 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@53b10504
[junit4:junit4] 2> 428018 T932 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 428019 T932 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2
[junit4:junit4] 2> 428020 T932 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index/
[junit4:junit4] 2> 428020 T932 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 428021 T932 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index
[junit4:junit4] 2> 428026 T932 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@29d234a1; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 428026 T932 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 428028 T932 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 428029 T932 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 428029 T932 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 428030 T932 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 428030 T932 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 428030 T932 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 428031 T932 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 428031 T932 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 428032 T932 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 428042 T932 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 428049 T932 oass.SolrIndexSearcher.<init> Opening Searcher@3cd62ff1 main
[junit4:junit4] 2> 428049 T932 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 428050 T932 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 428053 T933 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3cd62ff1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 428054 T932 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 428055 T932 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 428637 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 428638 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28462_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28462/cz_c"}
[junit4:junit4] 2> 428639 T896 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 428639 T896 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 428651 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 428652 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 428651 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 428651 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 429057 T932 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 429057 T932 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28462/cz_c collection:collection1 shard:shard1
[junit4:junit4] 2> 429060 T932 oasc.ZkController.register We are http://127.0.0.1:28462/cz_c/collection1/ and leader is http://127.0.0.1:28453/cz_c/collection1/
[junit4:junit4] 2> 429061 T932 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28462/cz_c
[junit4:junit4] 2> 429061 T932 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 429061 T932 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C535 name=collection1 org.apache.solr.core.SolrCore@ab9e8ea url=http://127.0.0.1:28462/cz_c/collection1 node=127.0.0.1:28462_cz_c C535_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:28462_cz_c, base_url=http://127.0.0.1:28462/cz_c}
[junit4:junit4] 2> 429062 T934 C535 P28462 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 429063 T934 C535 P28462 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 429063 T932 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 429063 T934 C535 P28462 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 429064 T934 C535 P28462 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 429064 T873 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 429065 T873 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 429065 T934 C535 P28462 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 429066 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 429092 T905 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:28462_cz_c_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 429379 T873 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 429382 T873 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28467
[junit4:junit4] 2> 429383 T873 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 429384 T873 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 429384 T873 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1369688918699
[junit4:junit4] 2> 429385 T873 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1369688918699/solr.xml
[junit4:junit4] 2> 429385 T873 oasc.CoreContainer.<init> New CoreContainer 316303587
[junit4:junit4] 2> 429386 T873 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1369688918699/'
[junit4:junit4] 2> 429387 T873 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1369688918699/'
[junit4:junit4] 2> 429532 T873 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 429533 T873 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 429534 T873 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 429534 T873 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 429535 T873 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 429535 T873 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 429536 T873 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 429536 T873 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 429537 T873 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 429537 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 429557 T873 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 429558 T873 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:28440/solr
[junit4:junit4] 2> 429559 T873 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 429560 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 429562 T946 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6109f85f name:ZooKeeperConnection Watcher:127.0.0.1:28440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 429563 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 429566 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 429580 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 429582 T948 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29a173b name:ZooKeeperConnection Watcher:127.0.0.1:28440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 429582 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 429594 T873 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 430157 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 430158 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:28462_cz_c_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28462_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28462/cz_c"}
[junit4:junit4] 2> 430212 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430212 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430212 T948 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430212 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430212 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430598 T873 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28467_cz_c
[junit4:junit4] 2> 430600 T873 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28467_cz_c
[junit4:junit4] 2> 430603 T948 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430603 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 430604 T931 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 430604 T895 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 430604 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 430604 T902 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 430604 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 430605 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 430605 T948 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 430605 T915 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 430626 T949 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1369688918699/collection1
[junit4:junit4] 2> 430626 T949 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 430627 T949 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 430627 T949 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 430629 T949 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1369688918699/collection1/'
[junit4:junit4] 2> 430631 T949 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1369688918699/collection1/lib/README' to classloader
[junit4:junit4] 2> 430631 T949 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1369688918699/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 430683 T949 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 430742 T949 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 430844 T949 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 430851 T949 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 431094 T905 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:28462_cz_c_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 431094 T905 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:28462_cz_c_collection1&state=recovering&nodeName=127.0.0.1:28462_cz_c&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 431470 T949 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 431482 T949 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 431486 T949 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 431503 T949 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 431509 T949 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 431513 T949 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 431514 T949 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 431515 T949 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 431515 T949 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 431516 T949 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 431517 T949 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 431517 T949 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 431517 T949 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1369688918699/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/
[junit4:junit4] 2> 431518 T949 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@53b10504
[junit4:junit4] 2> 431518 T949 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 431520 T949 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3
[junit4:junit4] 2> 431520 T949 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index/
[junit4:junit4] 2> 431521 T949 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 431522 T949 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index
[junit4:junit4] 2> 431529 T949 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b40b5bf; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 431530 T949 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 431533 T949 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 431534 T949 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 431534 T949 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 431535 T949 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 431536 T949 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 431536 T949 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 431536 T949 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 431537 T949 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 431537 T949 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 431554 T949 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 431564 T949 oass.SolrIndexSearcher.<init> Opening Searcher@3371661f main
[junit4:junit4] 2> 431565 T949 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 431565 T949 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 431569 T950 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3371661f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 431572 T949 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 431572 T949 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 431740 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 431740 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28467_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28467/cz_c"}
[junit4:junit4] 2> 431741 T896 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 431741 T896 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 431754 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 431754 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 431754 T948 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 431754 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 431754 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 432575 T949 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 432575 T949 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28467/cz_c collection:collection1 shard:shard1
[junit4:junit4] 2> 432580 T949 oasc.ZkController.register We are http://127.0.0.1:28467/cz_c/collection1/ and leader is http://127.0.0.1:28453/cz_c/collection1/
[junit4:junit4] 2> 432580 T949 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28467/cz_c
[junit4:junit4] 2> 432580 T949 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 432580 T949 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C536 name=collection1 org.apache.solr.core.SolrCore@3f100e7f url=http://127.0.0.1:28467/cz_c/collection1 node=127.0.0.1:28467_cz_c C536_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:28467_cz_c, base_url=http://127.0.0.1:28467/cz_c}
[junit4:junit4] 2> 432581 T951 C536 P28467 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 432582 T951 C536 P28467 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 432582 T949 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 432582 T951 C536 P28467 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 432582 T951 C536 P28467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 432583 T873 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 432584 T873 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 432584 T951 C536 P28467 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 432585 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 432607 T906 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:28467_cz_c_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 432909 T873 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 432912 T873 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28472
[junit4:junit4] 2> 432912 T873 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 432913 T873 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 432913 T873 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1369688922214
[junit4:junit4] 2> 432914 T873 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1369688922214/solr.xml
[junit4:junit4] 2> 432914 T873 oasc.CoreContainer.<init> New CoreContainer 2014609310
[junit4:junit4] 2> 432915 T873 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1369688922214/'
[junit4:junit4] 2> 432916 T873 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1369688922214/'
[junit4:junit4] 2> 433059 T873 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 433060 T873 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 433061 T873 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 433061 T873 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 433062 T873 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 433062 T873 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 433063 T873 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 433063 T873 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 433064 T873 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 433064 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 433083 T873 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 433083 T873 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:28440/solr
[junit4:junit4] 2> 433084 T873 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 433085 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 433092 T963 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@523b5cfe name:ZooKeeperConnection Watcher:127.0.0.1:28440 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 433092 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 433095 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> ASYNC NEW_CORE C537 name=collection1 org.apache.solr.core.SolrCore@ab9e8ea url=http://127.0.0.1:28462/cz_c/collection1 node=127.0.0.1:28462_cz_c C537_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:28462_cz_c, base_url=http://127.0.0.1:28462/cz_c}
[junit4:junit4] 2> 433096 T934 C537 P28462 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:28453/cz_c/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 433096 T934 C537 P28462 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28462/cz_c START replicas=[http://127.0.0.1:28453/cz_c/collection1/] nUpdates=100
[junit4:junit4] 2> 433096 T934 C537 P28462 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 433097 T934 C537 P28462 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 433097 T934 C537 P28462 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 433097 T934 C537 P28462 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 433098 T934 C537 P28462 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 433098 T934 C537 P28462 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:28453/cz_c/collection1/. core=collection1
[junit4:junit4] 2> 433098 T934 C537 P28462 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C538 name=collection1 org.apache.solr.core.SolrCore@84a91a7 url=http://127.0.0.1:28453/cz_c/collection1 node=127.0.0.1:28453_cz_c C538_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:28453_cz_c, base_url=http://127.0.0.1:28453/cz_c, leader=true}
[junit4:junit4] 2> 433104 T907 C538 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 433109 T873 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 433111 T966 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c888ac1 name:ZooKeeperConnection Watcher:127.0.0.1:28440/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 433112 T873 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 433112 T908 C538 P28453 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 433117 T908 C538 P28453 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 433117 T908 C538 P28453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 433123 T908 C538 P28453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 433124 T908 C538 P28453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 433124 T873 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 433125 T908 C538 P28453 oass.SolrIndexSearcher.<init> Opening Searcher@73da3f0 realtime
[junit4:junit4] 2> 433125 T908 C538 P28453 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 433125 T908 C538 P28453 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 433126 T934 C537 P28462 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 433127 T934 C537 P28462 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 433129 T909 C538 P28453 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 433129 T909 C538 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 433130 T934 C537 P28462 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 433130 T934 C537 P28462 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 433130 T934 C537 P28462 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 433134 T909 C538 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 433135 T934 C537 P28462 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 433137 T934 C537 P28462 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index.20130527230842744
[junit4:junit4] 2> 433138 T934 C537 P28462 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index.20130527230842744 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9291f72; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 433142 T909 C538 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 433145 T934 C537 P28462 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 433147 T934 C537 P28462 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 433148 T934 C537 P28462 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 433153 T934 C537 P28462 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@29d234a1; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@29d234a1; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 433153 T934 C537 P28462 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 433154 T934 C537 P28462 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 433155 T934 C537 P28462 oass.SolrIndexSearcher.<init> Opening Searcher@5e0fdd78 main
[junit4:junit4] 2> 433156 T933 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5e0fdd78 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 433156 T934 C537 P28462 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index.20130527230842744 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index.20130527230842744;done=true>>]
[junit4:junit4] 2> 433157 T934 C537 P28462 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index.20130527230842744
[junit4:junit4] 2> 433157 T934 C537 P28462 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index.20130527230842744
[junit4:junit4] 2> 433158 T934 C537 P28462 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 433158 T934 C537 P28462 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 433159 T934 C537 P28462 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 433159 T934 C537 P28462 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 433161 T934 C537 P28462 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 433260 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 433261 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:28467_cz_c_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28467_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28467/cz_c"}
[junit4:junit4] 2> 433265 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:28462_cz_c_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28462_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28462/cz_c"}
[junit4:junit4] 2> 433277 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 433277 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 433277 T966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 433277 T948 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 433277 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 433277 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 433608 T906 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:28467_cz_c_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 433608 T906 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:28467_cz_c_collection1&state=recovering&nodeName=127.0.0.1:28467_cz_c&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 434128 T873 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28472_cz_c
[junit4:junit4] 2> 434139 T873 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28472_cz_c
[junit4:junit4] 2> 434145 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 434145 T966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 434146 T895 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 434145 T948 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 434146 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 434146 T902 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 434146 T931 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 434147 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 434148 T915 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 434147 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 434153 T966 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 434154 T948 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 434163 T968 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1369688922214/collection1
[junit4:junit4] 2> 434164 T968 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 434164 T968 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 434165 T968 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 434166 T968 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1369688922214/collection1/'
[junit4:junit4] 2> 434168 T968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1369688922214/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 434168 T968 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1369688922214/collection1/lib/README' to classloader
[junit4:junit4] 2> 434252 T968 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 434312 T968 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 434413 T968 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 434420 T968 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 435034 T968 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 435045 T968 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 435049 T968 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 435066 T968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 435070 T968 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 435075 T968 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 435076 T968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 435077 T968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 435077 T968 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 435078 T968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 435079 T968 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 435079 T968 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 435079 T968 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1369688922214/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/
[junit4:junit4] 2> 435080 T968 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@53b10504
[junit4:junit4] 2> 435080 T968 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 435082 T968 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4
[junit4:junit4] 2> 435082 T968 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index/
[junit4:junit4] 2> 435083 T968 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 435084 T968 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index
[junit4:junit4] 2> 435140 T968 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61f9a224; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 435141 T968 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 435144 T968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 435145 T968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 435145 T968 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 435146 T968 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 435147 T968 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 435147 T968 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 435148 T968 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 435148 T968 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 435149 T968 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 435165 T968 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 435175 T968 oass.SolrIndexSearcher.<init> Opening Searcher@e371592 main
[junit4:junit4] 2> 435176 T968 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 435177 T968 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 435181 T969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e371592 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 435183 T968 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 435184 T968 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> ASYNC NEW_CORE C539 name=collection1 org.apache.solr.core.SolrCore@3f100e7f url=http://127.0.0.1:28467/cz_c/collection1 node=127.0.0.1:28467_cz_c C539_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:28467_cz_c, base_url=http://127.0.0.1:28467/cz_c}
[junit4:junit4] 2> 435610 T951 C539 P28467 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:28453/cz_c/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 435610 T951 C539 P28467 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28467/cz_c START replicas=[http://127.0.0.1:28453/cz_c/collection1/] nUpdates=100
[junit4:junit4] 2> 435611 T951 C539 P28467 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 435611 T951 C539 P28467 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 435611 T951 C539 P28467 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 435611 T951 C539 P28467 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 435611 T951 C539 P28467 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 435612 T951 C539 P28467 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:28453/cz_c/collection1/. core=collection1
[junit4:junit4] 2> 435612 T951 C539 P28467 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C540 name=collection1 org.apache.solr.core.SolrCore@84a91a7 url=http://127.0.0.1:28453/cz_c/collection1 node=127.0.0.1:28453_cz_c C540_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:28453_cz_c, base_url=http://127.0.0.1:28453/cz_c, leader=true}
[junit4:junit4] 2> 435614 T907 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 435630 T910 C540 P28453 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 435638 T910 C540 P28453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 435639 T910 C540 P28453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 435640 T910 C540 P28453 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 435640 T910 C540 P28453 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4] 2> 435642 T951 C539 P28467 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 435643 T951 C539 P28467 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 435645 T909 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 435646 T951 C539 P28467 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 435646 T951 C539 P28467 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 435647 T951 C539 P28467 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 435650 T909 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4] 2> 435651 T951 C539 P28467 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 435653 T951 C539 P28467 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index.20130527230845260
[junit4:junit4] 2> 435654 T951 C539 P28467 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index.20130527230845260 lockFactory=org.apache.lucene.store.NativeFSLockFactory@713b33f9; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 435658 T909 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 435661 T951 C539 P28467 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 435665 T951 C539 P28467 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 435665 T951 C539 P28467 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 435670 T951 C539 P28467 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b40b5bf; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b40b5bf; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 435671 T951 C539 P28467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 435671 T951 C539 P28467 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 435672 T951 C539 P28467 oass.SolrIndexSearcher.<init> Opening Searcher@2533d20e main
[junit4:junit4] 2> 435674 T950 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2533d20e main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 435674 T951 C539 P28467 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index.20130527230845260 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index.20130527230845260;done=true>>]
[junit4:junit4] 2> 435674 T951 C539 P28467 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index.20130527230845260
[junit4:junit4] 2> 435675 T951 C539 P28467 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index.20130527230845260
[junit4:junit4] 2> 435676 T951 C539 P28467 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 435676 T951 C539 P28467 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 435676 T951 C539 P28467 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 435676 T951 C539 P28467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 435678 T951 C539 P28467 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 436288 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 436289 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28472_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28472/cz_c"}
[junit4:junit4] 2> 436289 T896 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 436289 T896 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 436294 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:28467_cz_c_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28467_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28467/cz_c"}
[junit4:junit4] 2> 436306 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 436306 T966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 436306 T948 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 436306 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 436306 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 436306 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 437188 T968 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 437188 T968 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28472/cz_c collection:collection1 shard:shard1
[junit4:junit4] 2> 437192 T968 oasc.ZkController.register We are http://127.0.0.1:28472/cz_c/collection1/ and leader is http://127.0.0.1:28453/cz_c/collection1/
[junit4:junit4] 2> 437192 T968 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28472/cz_c
[junit4:junit4] 2> 437193 T968 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 437193 T968 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C541 name=collection1 org.apache.solr.core.SolrCore@138f483 url=http://127.0.0.1:28472/cz_c/collection1 node=127.0.0.1:28472_cz_c C541_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:28472_cz_c, base_url=http://127.0.0.1:28472/cz_c}
[junit4:junit4] 2> 437193 T972 C541 P28472 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 437194 T968 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 437194 T972 C541 P28472 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 437195 T972 C541 P28472 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 437195 T972 C541 P28472 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 437196 T873 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 437196 T873 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 437197 T972 C541 P28472 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 437197 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 437221 T873 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 437222 T911 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:28472_cz_c_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 437223 T873 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 437223 T873 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 437224 T873 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 437822 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 437823 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:28472_cz_c_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28472_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28472/cz_c"}
[junit4:junit4] 2> 437854 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 437854 T966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 437854 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 437854 T948 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 437854 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 437854 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 438223 T911 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:28472_cz_c_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 438223 T911 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:28472_cz_c_collection1&state=recovering&nodeName=127.0.0.1:28472_cz_c&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 438226 T873 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 439228 T873 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C541_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:28472_cz_c, base_url=http://127.0.0.1:28472/cz_c}
[junit4:junit4] 2> 440225 T972 C541 P28472 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:28453/cz_c/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 440225 T972 C541 P28472 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28472/cz_c START replicas=[http://127.0.0.1:28453/cz_c/collection1/] nUpdates=100
[junit4:junit4] 2> 440226 T972 C541 P28472 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 440226 T972 C541 P28472 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 440226 T972 C541 P28472 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 440226 T972 C541 P28472 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 440227 T972 C541 P28472 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 440227 T972 C541 P28472 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:28453/cz_c/collection1/. core=collection1
[junit4:junit4] 2> 440227 T972 C541 P28472 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 440229 T907 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 440231 T873 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 440239 T905 C540 P28453 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 440255 T905 C540 P28453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 440256 T905 C540 P28453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 440257 T905 C540 P28453 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 440257 T905 C540 P28453 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4] 2> 440258 T972 C541 P28472 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 440259 T972 C541 P28472 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 440261 T909 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 440262 T972 C541 P28472 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 440263 T972 C541 P28472 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 440263 T972 C541 P28472 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 440266 T909 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4] 2> 440267 T972 C541 P28472 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 440269 T972 C541 P28472 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index.20130527230849876
[junit4:junit4] 2> 440270 T972 C541 P28472 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index.20130527230849876 lockFactory=org.apache.lucene.store.NativeFSLockFactory@11800a9; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 440274 T909 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 440277 T972 C541 P28472 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 440308 T972 C541 P28472 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 440308 T972 C541 P28472 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 440313 T972 C541 P28472 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61f9a224; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61f9a224; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 440314 T972 C541 P28472 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 440314 T972 C541 P28472 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 440315 T972 C541 P28472 oass.SolrIndexSearcher.<init> Opening Searcher@3b9751ed main
[junit4:junit4] 2> 440317 T969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3b9751ed main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 440317 T972 C541 P28472 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index.20130527230849876 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index.20130527230849876;done=true>>]
[junit4:junit4] 2> 440318 T972 C541 P28472 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index.20130527230849876
[junit4:junit4] 2> 440318 T972 C541 P28472 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index.20130527230849876
[junit4:junit4] 2> 440319 T972 C541 P28472 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 440319 T972 C541 P28472 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 440320 T972 C541 P28472 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 440320 T972 C541 P28472 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 440372 T972 C541 P28472 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 440870 T896 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 440871 T896 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:28472_cz_c_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:28472_cz_c",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28472/cz_c"}
[junit4:junit4] 2> 440879 T931 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440879 T966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440879 T895 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440879 T915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440879 T902 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 440879 T948 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 441235 T873 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 441236 T873 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C542 name=collection1 org.apache.solr.core.SolrCore@40c459b9 url=http://127.0.0.1:28443/cz_c/collection1 node=127.0.0.1:28443_cz_c C542_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:28443_cz_c, base_url=http://127.0.0.1:28443/cz_c, leader=true}
[junit4:junit4] 2> 441251 T885 C542 P28443 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 441258 T885 C542 P28443 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c766b5f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 441258 T885 C542 P28443 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 441264 T885 C542 P28443 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c766b5f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c766b5f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 441264 T885 C542 P28443 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 441267 T885 C542 P28443 oass.SolrIndexSearcher.<init> Opening Searcher@179ea91 main
[junit4:junit4] 2> 441267 T885 C542 P28443 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 441268 T899 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@179ea91 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 441269 T885 C542 P28443 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4] 2> 441281 T908 C540 P28453 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 441286 T908 C540 P28453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 441287 T908 C540 P28453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 441288 T908 C540 P28453 oass.SolrIndexSearcher.<init> Opening Searcher@28319c9d main
[junit4:junit4] 2> 441289 T908 C540 P28453 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 441290 T917 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@28319c9d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 441290 T908 C540 P28453 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:28462/cz_c/collection1/, StdNode: http://127.0.0.1:28467/cz_c/collection1/, StdNode: http://127.0.0.1:28472/cz_c/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> ASYNC NEW_CORE C543 name=collection1 org.apache.solr.core.SolrCore@ab9e8ea url=http://127.0.0.1:28462/cz_c/collection1 node=127.0.0.1:28462_cz_c C543_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:28462_cz_c, base_url=http://127.0.0.1:28462/cz_c}
[junit4:junit4] 2> 441308 T921 C543 P28462 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C541_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:28472_cz_c, base_url=http://127.0.0.1:28472/cz_c}
[junit4:junit4] 2> 441309 T955 C541 P28472 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C539_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:28467_cz_c, base_url=http://127.0.0.1:28467/cz_c}
[junit4:junit4] 2> 441309 T938 C539 P28467 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 441324 T921 C543 P28462 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@29d234a1; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@29d234a1; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 441325 T921 C543 P28462 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 441328 T921 C543 P28462 oass.SolrIndexSearcher.<init> Opening Searcher@746b6605 main
[junit4:junit4] 2> 441328 T921 C543 P28462 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 441329 T933 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@746b6605 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 441330 T921 C543 P28462 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 441332 T955 C541 P28472 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61f9a224; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61f9a224; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 441332 T938 C539 P28467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b40b5bf; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b40b5bf; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 441332 T955 C541 P28472 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 441333 T938 C539 P28467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 441335 T955 C541 P28472 oass.SolrIndexSearcher.<init> Opening Searcher@15b672a0 main
[junit4:junit4] 2> 441336 T938 C539 P28467 oass.SolrIndexSearcher.<init> Opening Searcher@1b554dfb main
[junit4:junit4] 2> 441336 T955 C541 P28472 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 441336 T938 C539 P28467 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 441337 T969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15b672a0 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 441337 T950 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b554dfb main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 441338 T955 C541 P28472 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 29
[junit4:junit4] 2> 441338 T938 C539 P28467 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 29
[junit4:junit4] 2> 441339 T908 C540 P28453 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 58
[junit4:junit4] 2> 441340 T873 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 441343 T906 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 441346 T922 C543 P28462 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 441348 T939 C539 P28467 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 441351 T956 C541 P28472 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 443357 T885 C542 P28443 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436222942571659264)} 0 2
[junit4:junit4] 2> 443372 T955 C541 P28472 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={update.distrib=FROMLEADER&_version_=-1436222942578999296&update.from=http://127.0.0.1:28453/cz_c/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436222942578999296)} 0 3
[junit4:junit4] 2> 443372 T938 C539 P28467 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={update.distrib=FROMLEADER&_version_=-1436222942578999296&update.from=http://127.0.0.1:28453/cz_c/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436222942578999296)} 0 3
[junit4:junit4] 2> 443373 T921 C543 P28462 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={update.distrib=FROMLEADER&_version_=-1436222942578999296&update.from=http://127.0.0.1:28453/cz_c/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436222942578999296)} 0 4
[junit4:junit4] 2> 443375 T908 C540 P28453 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436222942578999296)} 0 14
[junit4:junit4] 2> 443386 T885 C542 P28443 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={wt=javabin&version=2} {add=[0 (1436222942596825088)]} 0 8
[junit4:junit4] 2> 443403 T921 C543 P28462 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={distrib.from=http://127.0.0.1:28453/cz_c/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1436222942608359424)]} 0 5
[junit4:junit4] 2> 443405 T955 C541 P28472 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={distrib.from=http://127.0.0.1:28453/cz_c/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1436222942608359424)]} 0 7
[junit4:junit4] 2> 443405 T938 C539 P28467 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={distrib.from=http://127.0.0.1:28453/cz_c/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1436222942608359424)]} 0 7
[junit4:junit4] 2> 443407 T908 C540 P28453 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={wt=javabin&version=2} {add=[0 (1436222942608359424)]} 0 17
[junit4:junit4] 2> 443413 T885 C542 P28443 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={wt=javabin&version=2} {add=[1 (1436222942630379520)]} 0 2
[junit4:junit4] 2> 443425 T921 C543 P28462 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={distrib.from=http://127.0.0.1:28453/cz_c/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1436222942637719552)]} 0 2
[junit4:junit4] 2> 443426 T955 C541 P28472 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={distrib.from=http://127.0.0.1:28453/cz_c/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1436222942637719552)]} 0 3
[junit4:junit4] 2> 443425 T938 C539 P28467 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={distrib.from=http://127.0.0.1:28453/cz_c/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1436222942637719552)]} 0 1
[junit4:junit4] 2> 443428 T908 C540 P28453 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={wt=javabin&version=2} {add=[1 (1436222942637719552)]} 0 10
[junit4:junit4] 2> 443433 T885 C542 P28443 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={wt=javabin&version=2} {add=[2 (1436222942652399616)]} 0 1
[junit4:junit4] 2> 443438 T908 C540 P28453 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:28462/cz_c/collection1/]
[junit4:junit4] 2> 443438 T908 C540 P28453 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:28462/cz_c/collection1/ against:[http://127.0.0.1:28462/cz_c/collection1/] result:true
[junit4:junit4] 2> 443439 T908 C540 P28453 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:28467/cz_c/collection1/ against:[http://127.0.0.1:28462/cz_c/collection1/] result:false
[junit4:junit4] 2> 443439 T908 C540 P28453 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:28472/cz_c/collection1/ against:[http://127.0.0.1:28462/cz_c/collection1/] result:false
[junit4:junit4] 2> 443445 T955 C541 P28472 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={distrib.from=http://127.0.0.1:28453/cz_c/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:28462/cz_c/collection1/&wt=javabin&version=2} {add=[2 (1436222942660788224)]} 0 2
[junit4:junit4] 2> 443445 T938 C539 P28467 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={distrib.from=http://127.0.0.1:28453/cz_c/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:28462/cz_c/collection1/&wt=javabin&version=2} {add=[2 (1436222942660788224)]} 0 1
[junit4:junit4] 2> 443446 T908 C540 P28453 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={test.distrib.skip.servers=http://127.0.0.1:28462/cz_c/collection1/&wt=javabin&version=2} {add=[2 (1436222942660788224)]} 0 9
[junit4:junit4] 2> 443453 T885 C542 P28443 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={wt=javabin&version=2} {add=[3 (1436222942672322560)]} 0 3
[junit4:junit4] 2> 443457 T908 C540 P28453 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:28467/cz_c/collection1/, http://127.0.0.1:28462/cz_c/collection1/]
[junit4:junit4] 2> 443457 T908 C540 P28453 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:28462/cz_c/collection1/ against:[http://127.0.0.1:28467/cz_c/collection1/, http://127.0.0.1:28462/cz_c/collection1/] result:true
[junit4:junit4] 2> 443458 T908 C540 P28453 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:28467/cz_c/collection1/ against:[http://127.0.0.1:28467/cz_c/collection1/, http://127.0.0.1:28462/cz_c/collection1/] result:true
[junit4:junit4] 2> 443458 T908 C540 P28453 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:28472/cz_c/collection1/ against:[http://127.0.0.1:28467/cz_c/collection1/, http://127.0.0.1:28462/cz_c/collection1/] result:false
[junit4:junit4] 2> 443468 T955 C541 P28472 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={distrib.from=http://127.0.0.1:28453/cz_c/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:28462/cz_c/collection1/&wt=javabin&version=2} {add=[3 (1436222942680711168)]} 0 3
[junit4:junit4] 2> 443470 T908 C540 P28453 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={test.distrib.skip.servers=http://127.0.0.1:28462/cz_c/collection1/&test.distrib.skip.servers=http://127.0.0.1:28467/cz_c/collection1/&wt=javabin&version=2} {add=[3 (1436222942680711168)]} 0 13
[junit4:junit4] 2> 443475 T885 C542 P28443 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 443568 T885 C542 P28443 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c766b5f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c766b5f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 443569 T885 C542 P28443 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 443581 T885 C542 P28443 oass.SolrIndexSearcher.<init> Opening Searcher@ab45d57 main
[junit4:junit4] 2> 443582 T885 C542 P28443 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 443583 T899 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ab45d57 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 443584 T885 C542 P28443 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 110
[junit4:junit4] 2> 443588 T908 C540 P28453 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 443671 T908 C540 P28453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 443672 T908 C540 P28453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 443685 T908 C540 P28453 oass.SolrIndexSearcher.<init> Opening Searcher@6366624f main
[junit4:junit4] 2> 443687 T908 C540 P28453 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 443688 T917 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6366624f main{StandardDirectoryReader(segments_6:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 443689 T908 C540 P28453 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:28462/cz_c/collection1/, StdNode: http://127.0.0.1:28467/cz_c/collection1/, StdNode: http://127.0.0.1:28472/cz_c/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 443693 T938 C539 P28467 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 443693 T921 C543 P28462 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 443693 T955 C541 P28472 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 443835 T938 C539 P28467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b40b5bf; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b40b5bf; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 443836 T938 C539 P28467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 443839 T955 C541 P28472 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61f9a224; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@61f9a224; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 443840 T955 C541 P28472 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 443849 T938 C539 P28467 oass.SolrIndexSearcher.<init> Opening Searcher@2f86c592 main
[junit4:junit4] 2> 443850 T938 C539 P28467 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 443852 T955 C541 P28472 oass.SolrIndexSearcher.<init> Opening Searcher@7542d7cb main
[junit4:junit4] 2> 443853 T950 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f86c592 main{StandardDirectoryReader(segments_5:3:nrt _0(5.0):C3)}
[junit4:junit4] 2> 443854 T938 C539 P28467 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 161
[junit4:junit4] 2> 443854 T955 C541 P28472 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 443855 T921 C543 P28462 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@29d234a1; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@29d234a1; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 443856 T921 C543 P28462 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 443854 T969 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7542d7cb main{StandardDirectoryReader(segments_6:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 443862 T955 C541 P28472 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 169
[junit4:junit4] 2> 443866 T921 C543 P28462 oass.SolrIndexSearcher.<init> Opening Searcher@95cb4d5 main
[junit4:junit4] 2> 443867 T921 C543 P28462 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 443867 T933 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@95cb4d5 main{StandardDirectoryReader(segments_4:3:nrt _0(5.0):C2)}
[junit4:junit4] 2> 443868 T921 C543 P28462 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 175
[junit4:junit4] 2> 443869 T908 C540 P28453 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 282
[junit4:junit4] 2> 443870 T873 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 443872 T873 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 443873 T873 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 443877 T906 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4] 2> 443881 T922 C543 P28462 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=1
[junit4:junit4] 2> 443885 T939 C539 P28467 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=3 status=0 QTime=1
[junit4:junit4] 2> 443888 T956 C541 P28472 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 443890 T873 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 443917 T940 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 443918 T940 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 443933 T910 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 443934 T910 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:28453/cz_c/collection1/
[junit4:junit4] 2> 443935 T910 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28453/cz_c START replicas=[http://127.0.0.1:28462/cz_c/collection1/, http://127.0.0.1:28467/cz_c/collection1/, http://127.0.0.1:28472/cz_c/collection1/] nUpdates=100
[junit4:junit4] 2> 443939 T941 C539 P28467 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 443939 T923 C543 P28462 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 443939 T957 C541 P28472 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 443940 T910 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:28453/cz_c Received 4 versions from 127.0.0.1:28467/cz_c/collection1/
[junit4:junit4] 2> 443941 T910 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:28453/cz_c Our versions are newer. ourLowThreshold=1436222942578999296 otherHigh=1436222942660788224
[junit4:junit4] 2> 443942 T910 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:28453/cz_c Received 3 versions from 127.0.0.1:28462/cz_c/collection1/
[junit4:junit4] 2> 443942 T910 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:28453/cz_c Our versions are newer. ourLowThreshold=1436222942578999296 otherHigh=1436222942637719552
[junit4:junit4] 2> 443943 T910 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:28453/cz_c Received 5 versions from 127.0.0.1:28472/cz_c/collection1/
[junit4:junit4] 2> 443943 T910 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:28453/cz_c Our versions are newer. ourLowThreshold=1436222942578999296 otherHigh=1436222942660788224
[junit4:junit4] 2> 443943 T910 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28453/cz_c DONE. sync succeeded
[junit4:junit4] 2> 443944 T910 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 443944 T910 oasc.SyncStrategy.syncToMe http://127.0.0.1:28453/cz_c/collection1/: try and ask http://127.0.0.1:28462/cz_c/collection1/ to sync
[junit4:junit4] 2> 443945 T910 oasc.SyncStrategy.syncToMe http://127.0.0.1:28453/cz_c/collection1/: try and ask http://127.0.0.1:28467/cz_c/collection1/ to sync
[junit4:junit4] 2> 443945 T910 oasc.SyncStrategy.syncToMe http://127.0.0.1:28453/cz_c/collection1/: try and ask http://127.0.0.1:28472/cz_c/collection1/ to sync
[junit4:junit4] 2> 443947 T924 C543 P28462 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28462/cz_c START replicas=[http://127.0.0.1:28453/cz_c/collection1/] nUpdates=100
[junit4:junit4] 2> 443948 T942 C539 P28467 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28467/cz_c START replicas=[http://127.0.0.1:28453/cz_c/collection1/] nUpdates=100
[junit4:junit4] 2> 443948 T958 C541 P28472 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28472/cz_c START replicas=[http://127.0.0.1:28453/cz_c/collection1/] nUpdates=100
[junit4:junit4] 2> 443950 T911 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 443951 T905 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 443951 T942 C539 P28467 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:28467/cz_c Received 5 versions from 127.0.0.1:28453/cz_c/collection1/
[junit4:junit4] 2> 443952 T958 C541 P28472 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:28472/cz_c Received 5 versions from 127.0.0.1:28453/cz_c/collection1/
[junit4:junit4] 2> 443952 T907 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 443952 T942 C539 P28467 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:28467/cz_c Requesting updates from 127.0.0.1:28453/cz_c/collection1/n=1 versions=[1436222942680711168]
[junit4:junit4] 2> 443952 T958 C541 P28472 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:28472/cz_c Our versions are newer. ourLowThreshold=1436222942578999296 otherHigh=1436222942660788224
[junit4:junit4] 2> 443954 T924 C543 P28462 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:28462/cz_c Received 5 versions from 127.0.0.1:28453/cz_c/collection1/
[junit4:junit4] 2> 443954 T958 C541 P28472 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28472/cz_c DONE. sync succeeded
[junit4:junit4] 2> 443955 T924 C543 P28462 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:28462/cz_c Requesting updates from 127.0.0.1:28453/cz_c/collection1/n=2 versions=[1436222942680711168, 1436222942660788224]
[junit4:junit4] 2> 443955 T958 C541 P28472 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={sync=http://127.0.0.1:28453/cz_c/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=7
[junit4:junit4] 2> 443956 T910 oasc.SyncStrategy.syncToMe http://127.0.0.1:28453/cz_c/collection1/: sync completed with http://127.0.0.1:28472/cz_c/collection1/
[junit4:junit4] 2> 443957 T907 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={distrib=false&getUpdates=1436222942680711168&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 443959 T905 C540 P28453 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={distrib=false&getUpdates=1436222942680711168,1436222942660788224&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 443966 T942 C539 P28467 oasup.LogUpdateProcessor.finish [collection1] {add=[3 (1436222942680711168)]} 0 7
[junit4:junit4] 2> 443966 T942 C539 P28467 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28467/cz_c DONE. sync succeeded
[junit4:junit4] 2> 443967 T942 C539 P28467 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={sync=http://127.0.0.1:28453/cz_c/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=19
[junit4:junit4] 2> 443967 T924 C543 P28462 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1436222942660788224), 3 (1436222942680711168)]} 0 7
[junit4:junit4] 2> 443968 T924 C543 P28462 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28462/cz_c DONE. sync succeeded
[junit4:junit4] 2> 443968 T910 oasc.SyncStrategy.syncToMe http://127.0.0.1:28453/cz_c/collection1/: sync completed with http://127.0.0.1:28467/cz_c/collection1/
[junit4:junit4] 2> 443968 T924 C543 P28462 oasc.SolrCore.execute [collection1] webapp=/cz_c path=/get params={sync=http://127.0.0.1:28453/cz_c/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=21
[junit4:junit4] 2> 443969 T910 oasc.SyncStrategy.syncToMe http://127.0.0.1:28453/cz_c/collection1/: sync completed with http://127.0.0.1:28462/cz_c/collection1/
[junit4:junit4] 2> 443970 T910 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={shard=shard1&action=REQUESTSYNCSHARD&core=collection1&collection=collection1&wt=javabin&version=2} status=0 QTime=37
[junit4:junit4] 2> 443971 T940 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2} status=0 QTime=53
[junit4:junit4] 2> 443971 T873 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 443972 T873 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 443973 T873 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 443974 T873 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 443978 T885 C542 P28443 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 443993 T885 C542 P28443 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c766b5f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7c766b5f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 443994 T885 C542 P28443 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 443997 T885 C542 P28443 oass.SolrIndexSearcher.<init> Opening Searcher@20cc6c main
[junit4:junit4] 2> 443998 T885 C542 P28443 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 443998 T899 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20cc6c main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 443999 T885 C542 P28443 oasup.LogUpdateProcessor.finish [collection1] webapp=/cz_c path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4] 2> 444004 T908 C540 P28453 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 444017 T908 C540 P28453 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3d68a231; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_7,generation=7}
[junit4:junit4] 2> 444018 T908 C540 P28453 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
[junit4:junit4] 2> 444021 T908 C540 P28453 oass.SolrIndexSearcher.<init> Opening Searcher@2f7d3a1e main
[junit4:junit4] 2> 444022 T908 C540 P28453 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 444023 T917 oasc.SolrCore.registerSearcher [collectio
[...truncated too long message...]
:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1327414 T948 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1328469 T966 oasu.PeerSync.handleResponse WARN PeerSync: core=collection1 url=http://127.0.0.1:28472/cz_c couldn't connect to http://127.0.0.1:28467/cz_c/collection1/, counting as success
[junit4:junit4] 2> 1328469 T966 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:28472/cz_c DONE. sync succeeded
[junit4:junit4] 2> 1328469 T966 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1328470 T966 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4] 2> 1328470 T966 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:28472/cz_c/collection1/
[junit4:junit4] 2> 1328470 T966 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@138f483
[junit4:junit4] 2> 1328471 T966 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=51,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1328472 T966 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1328472 T966 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1328472 T966 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1328475 T966 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1328476 T966 oasc.CachingDirectoryFactory.close Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1328477 T966 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4;done=false>>]
[junit4:junit4] 2> 1328477 T966 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4
[junit4:junit4] 2> 1328477 T966 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index;done=false>>]
[junit4:junit4] 2> 1328477 T966 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369688906844/jetty4/index
[junit4:junit4] 2> 1328478 T966 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1328478 T966 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89763932199387148-127.0.0.1:28472_cz_c_collection1-n_0000000006
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1328479 T966 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1328479 T966 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1328480 T966 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1328480 T966 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=mt, timezone=Europe/Stockholm
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=4,free=171265040,total=360710144
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestJoin, DistributedQueryElevationComponentTest, SpatialFilterTest, CoreAdminHandlerTest, TestSolrCoreProperties, BinaryUpdateRequestHandlerTest, QueryParsingTest, TestConfig, TestSearchPerf, CircularListTest, TestPropInjectDefaults, TestPHPSerializedResponseWriter, AliasIntegrationTest, TestPseudoReturnFields, SynonymTokenizerTest, AlternateDirectoryTest, SolrIndexSplitterTest, TestWriterPerf, MoreLikeThisHandlerTest, TestFieldCollectionResource, TermVectorComponentTest, TestBadConfig, SimpleFacetsTest, QueryResultKeyTest, SolrCoreTest, TestExtendedDismaxParser, TestFaceting, DistributedSpellCheckComponentTest, ChaosMonkeyNothingIsSafeTest, PrimUtilsTest, FastVectorHighlighterTest, FileBasedSpellCheckerTest, CacheHeaderTest, TestLRUCache, TestFuzzyAnalyzedSuggestions, SystemInfoHandlerTest, MBeansHandlerTest, ShowFileRequestHandlerTest, TestStressRecovery, SuggesterFSTTest, PrimitiveFieldTypeTest, DirectUpdateHandlerOptimizeTest, BasicFunctionalityTest, TestLMDirichletSimilarityFactory, TestCloudManagedSchemaAddField, TestManagedSchema, ResponseLogComponentTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 911.67s, 1 test, 1 failure <<< FAILURES!
[...truncated 526 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:380: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:360: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 56 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4024 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4024/
1 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:58584 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:58584 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([C231A6167E827A75:43D7280E09DD1A49]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9483 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 759214 T2013 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 759220 T2013 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-ShardSplitTest-1369790419003
[junit4:junit4] 2> 759222 T2013 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 759222 T2014 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 759323 T2013 oasc.ZkTestServer.run start zk server on port:58575
[junit4:junit4] 2> 759324 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 759361 T2020 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b69046a name:ZooKeeperConnection Watcher:127.0.0.1:58575 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 759361 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 759362 T2013 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 759373 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 759375 T2022 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7780ef7d name:ZooKeeperConnection Watcher:127.0.0.1:58575/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 759375 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 759376 T2013 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 759386 T2013 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 759389 T2013 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 759392 T2013 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 759401 T2013 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 759401 T2013 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 759415 T2013 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 759415 T2013 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 759519 T2013 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 759520 T2013 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 759523 T2013 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 759524 T2013 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 759527 T2013 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 759528 T2013 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 759531 T2013 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 759532 T2013 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 759535 T2013 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 759536 T2013 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 759539 T2013 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 759540 T2013 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 759544 T2013 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 759544 T2013 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 759814 T2013 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 759819 T2013 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58578
[junit4:junit4] 2> 759820 T2013 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 759820 T2013 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 759821 T2013 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369790419330
[junit4:junit4] 2> 759821 T2013 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369790419330/solr.xml
[junit4:junit4] 2> 759822 T2013 oasc.CoreContainer.<init> New CoreContainer 1279303062
[junit4:junit4] 2> 759823 T2013 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369790419330/'
[junit4:junit4] 2> 759823 T2013 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369790419330/'
[junit4:junit4] 2> 759982 T2013 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 759983 T2013 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 759984 T2013 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 759984 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 759985 T2013 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 759985 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 759986 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 759986 T2013 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 759987 T2013 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 759987 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 760006 T2013 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 760007 T2013 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58575/solr
[junit4:junit4] 2> 760007 T2013 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 760008 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 760017 T2033 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b14dd9f name:ZooKeeperConnection Watcher:127.0.0.1:58575 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 760017 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 760022 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 760035 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 760046 T2035 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3299631 name:ZooKeeperConnection Watcher:127.0.0.1:58575/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 760046 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 760048 T2013 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 760053 T2013 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 760056 T2013 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 760058 T2013 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58578_
[junit4:junit4] 2> 760059 T2013 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58578_
[junit4:junit4] 2> 760062 T2013 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 760068 T2013 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 760070 T2013 oasc.Overseer.start Overseer (id=89770584900304899-127.0.0.1:58578_-n_0000000000) starting
[junit4:junit4] 2> 760074 T2013 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 760078 T2037 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 760079 T2013 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 760081 T2013 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 760083 T2013 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 760086 T2036 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 760090 T2038 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369790419330/collection1
[junit4:junit4] 2> 760090 T2038 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 760091 T2038 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 760091 T2038 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 760093 T2038 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369790419330/collection1/'
[junit4:junit4] 2> 760095 T2038 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369790419330/collection1/lib/README' to classloader
[junit4:junit4] 2> 760096 T2038 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369790419330/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 760154 T2038 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 760220 T2038 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 760322 T2038 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 760328 T2038 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 760909 T2038 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 760913 T2038 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 760915 T2038 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 760921 T2038 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 760948 T2038 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 760949 T2038 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369790419330/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369790419002/control/data/
[junit4:junit4] 2> 760949 T2038 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@596d444a
[junit4:junit4] 2> 760950 T2038 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 760950 T2038 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/control/data
[junit4:junit4] 2> 760951 T2038 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369790419002/control/data/index/
[junit4:junit4] 2> 760951 T2038 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369790419002/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 760951 T2038 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/control/data/index
[junit4:junit4] 2> 760956 T2038 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4fd3a6e lockFactory=org.apache.lucene.store.NativeFSLockFactory@664f83d6),segFN=segments_1,generation=1}
[junit4:junit4] 2> 760957 T2038 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 760960 T2038 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 760960 T2038 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 760961 T2038 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 760962 T2038 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 760962 T2038 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 760962 T2038 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 760963 T2038 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 760963 T2038 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 760964 T2038 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 760980 T2038 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 760988 T2038 oass.SolrIndexSearcher.<init> Opening Searcher@3219e987 main
[junit4:junit4] 2> 760988 T2038 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369790419002/control/data/tlog
[junit4:junit4] 2> 760990 T2038 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 760990 T2038 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 760994 T2039 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3219e987 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 760996 T2038 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 760996 T2038 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 761589 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 761590 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58578_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58578"}
[junit4:junit4] 2> 761591 T2036 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 761591 T2036 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 761603 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 762000 T2038 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 762000 T2038 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58578 collection:control_collection shard:shard1
[junit4:junit4] 2> 762001 T2038 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 762022 T2038 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 762031 T2038 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 762031 T2038 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 762032 T2038 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58578/collection1/
[junit4:junit4] 2> 762032 T2038 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 762032 T2038 oasc.SyncStrategy.syncToMe http://127.0.0.1:58578/collection1/ has no replicas
[junit4:junit4] 2> 762033 T2038 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58578/collection1/
[junit4:junit4] 2> 762033 T2038 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 763108 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 763127 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 763168 T2038 oasc.ZkController.register We are http://127.0.0.1:58578/collection1/ and leader is http://127.0.0.1:58578/collection1/
[junit4:junit4] 2> 763168 T2038 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58578
[junit4:junit4] 2> 763168 T2038 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 763169 T2038 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 763169 T2038 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 763171 T2038 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 763172 T2013 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 763173 T2013 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 763173 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 763192 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 763194 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 763196 T2042 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8561168 name:ZooKeeperConnection Watcher:127.0.0.1:58575/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 763196 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 763197 T2013 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 763200 T2013 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 763496 T2013 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 763499 T2013 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58584
[junit4:junit4] 2> 763500 T2013 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 763501 T2013 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 763501 T2013 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369790422982
[junit4:junit4] 2> 763502 T2013 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369790422982/solr.xml
[junit4:junit4] 2> 763502 T2013 oasc.CoreContainer.<init> New CoreContainer 1931612885
[junit4:junit4] 2> 763503 T2013 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369790422982/'
[junit4:junit4] 2> 763504 T2013 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369790422982/'
[junit4:junit4] 2> 763638 T2013 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 763639 T2013 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 763639 T2013 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 763640 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 763640 T2013 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 763641 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 763642 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 763642 T2013 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 763643 T2013 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 763643 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 763662 T2013 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 763663 T2013 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58575/solr
[junit4:junit4] 2> 763664 T2013 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 763665 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 763678 T2053 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71fbc61a name:ZooKeeperConnection Watcher:127.0.0.1:58575 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 763678 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 763686 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 763700 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 763704 T2055 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@570f906e name:ZooKeeperConnection Watcher:127.0.0.1:58575/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 763704 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 763738 T2013 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 764639 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 764640 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:58578__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58578_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58578"}
[junit4:junit4] 2> 764663 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 764663 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 764669 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 764742 T2013 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58584_
[junit4:junit4] 2> 764744 T2013 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58584_
[junit4:junit4] 2> 764747 T2035 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 764747 T2055 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 764747 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 764747 T2042 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 764748 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 764748 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 764755 T2056 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369790422982/collection1
[junit4:junit4] 2> 764756 T2056 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 764757 T2056 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 764757 T2056 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 764758 T2056 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369790422982/collection1/'
[junit4:junit4] 2> 764760 T2056 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369790422982/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 764760 T2056 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369790422982/collection1/lib/README' to classloader
[junit4:junit4] 2> 764812 T2056 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 764871 T2056 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 764973 T2056 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 764979 T2056 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 765545 T2056 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 765549 T2056 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 765552 T2056 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 765557 T2056 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 765584 T2056 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 765584 T2056 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369790422982/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty1/
[junit4:junit4] 2> 765584 T2056 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@596d444a
[junit4:junit4] 2> 765585 T2056 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 765586 T2056 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty1
[junit4:junit4] 2> 765586 T2056 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty1/index/
[junit4:junit4] 2> 765586 T2056 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 765587 T2056 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty1/index
[junit4:junit4] 2> 765591 T2056 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b309ea7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54bb2ac6),segFN=segments_1,generation=1}
[junit4:junit4] 2> 765591 T2056 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 765594 T2056 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 765595 T2056 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 765596 T2056 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 765596 T2056 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 765597 T2056 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 765597 T2056 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 765598 T2056 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 765598 T2056 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 765599 T2056 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 765615 T2056 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 765623 T2056 oass.SolrIndexSearcher.<init> Opening Searcher@3a4f13a main
[junit4:junit4] 2> 765623 T2056 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty1/tlog
[junit4:junit4] 2> 765624 T2056 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 765625 T2056 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 765630 T2057 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a4f13a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 765632 T2056 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 765632 T2056 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 766175 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 766175 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58584_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58584"}
[junit4:junit4] 2> 766176 T2036 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 766176 T2036 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 766196 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 766196 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 766196 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 766639 T2056 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 766639 T2056 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58584 collection:collection1 shard:shard1
[junit4:junit4] 2> 766640 T2056 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 766675 T2056 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 766685 T2056 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 766686 T2056 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 766686 T2056 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58584/collection1/
[junit4:junit4] 2> 766686 T2056 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 766687 T2056 oasc.SyncStrategy.syncToMe http://127.0.0.1:58584/collection1/ has no replicas
[junit4:junit4] 2> 766687 T2056 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58584/collection1/
[junit4:junit4] 2> 766687 T2056 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 767700 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 767722 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 767722 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 767722 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 767773 T2056 oasc.ZkController.register We are http://127.0.0.1:58584/collection1/ and leader is http://127.0.0.1:58584/collection1/
[junit4:junit4] 2> 767773 T2056 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58584
[junit4:junit4] 2> 767773 T2056 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 767774 T2056 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 767774 T2056 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 767776 T2056 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 767777 T2013 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 767778 T2013 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 767778 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 768062 T2013 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 768065 T2013 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58588
[junit4:junit4] 2> 768066 T2013 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 768066 T2013 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 768067 T2013 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369790427577
[junit4:junit4] 2> 768067 T2013 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369790427577/solr.xml
[junit4:junit4] 2> 768068 T2013 oasc.CoreContainer.<init> New CoreContainer 1674292404
[junit4:junit4] 2> 768069 T2013 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369790427577/'
[junit4:junit4] 2> 768069 T2013 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369790427577/'
[junit4:junit4] 2> 768197 T2013 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 768198 T2013 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 768199 T2013 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 768199 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 768200 T2013 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 768200 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 768201 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 768201 T2013 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 768202 T2013 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 768202 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 768219 T2013 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 768220 T2013 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58575/solr
[junit4:junit4] 2> 768220 T2013 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 768221 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 768224 T2069 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@437a98a7 name:ZooKeeperConnection Watcher:127.0.0.1:58575 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 768225 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 768241 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 768253 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 768255 T2071 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aa8a31c name:ZooKeeperConnection Watcher:127.0.0.1:58575/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 768255 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 768265 T2013 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 769227 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 769228 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:58584__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58584_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58584"}
[junit4:junit4] 2> 769252 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 769252 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 769252 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 769252 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 769268 T2013 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58588_
[junit4:junit4] 2> 769273 T2013 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58588_
[junit4:junit4] 2> 769282 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 769282 T2042 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 769282 T2055 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 769282 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 769282 T2035 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 769282 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 769283 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 769283 T2071 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 769298 T2072 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369790427577/collection1
[junit4:junit4] 2> 769299 T2072 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 769299 T2072 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 769300 T2072 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 769301 T2072 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369790427577/collection1/'
[junit4:junit4] 2> 769303 T2072 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369790427577/collection1/lib/README' to classloader
[junit4:junit4] 2> 769304 T2072 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369790427577/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 769367 T2072 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 769439 T2072 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 769541 T2072 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 769547 T2072 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 770113 T2072 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 770117 T2072 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 770119 T2072 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 770125 T2072 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 770150 T2072 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 770151 T2072 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369790427577/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty2/
[junit4:junit4] 2> 770151 T2072 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@596d444a
[junit4:junit4] 2> 770152 T2072 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 770153 T2072 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty2
[junit4:junit4] 2> 770153 T2072 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty2/index/
[junit4:junit4] 2> 770153 T2072 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 770154 T2072 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty2/index
[junit4:junit4] 2> 770158 T2072 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ee1e101 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb11f3d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 770158 T2072 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 770161 T2072 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 770162 T2072 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 770163 T2072 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 770163 T2072 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 770164 T2072 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 770164 T2072 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 770165 T2072 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 770165 T2072 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 770166 T2072 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 770182 T2072 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 770188 T2072 oass.SolrIndexSearcher.<init> Opening Searcher@63e58faa main
[junit4:junit4] 2> 770189 T2072 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty2/tlog
[junit4:junit4] 2> 770190 T2072 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 770190 T2072 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 770195 T2073 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@63e58faa main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 770197 T2072 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 770197 T2072 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 770765 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 770766 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58588_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58588"}
[junit4:junit4] 2> 770767 T2036 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 770767 T2036 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 770783 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 770783 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 770783 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 770783 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 771226 T2072 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 771226 T2072 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58588 collection:collection1 shard:shard2
[junit4:junit4] 2> 771227 T2072 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 771244 T2072 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 771255 T2072 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 771255 T2072 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 771256 T2072 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58588/collection1/
[junit4:junit4] 2> 771256 T2072 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 771256 T2072 oasc.SyncStrategy.syncToMe http://127.0.0.1:58588/collection1/ has no replicas
[junit4:junit4] 2> 771257 T2072 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58588/collection1/
[junit4:junit4] 2> 771257 T2072 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 772288 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 772313 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 772313 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 772313 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 772313 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 772340 T2072 oasc.ZkController.register We are http://127.0.0.1:58588/collection1/ and leader is http://127.0.0.1:58588/collection1/
[junit4:junit4] 2> 772340 T2072 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58588
[junit4:junit4] 2> 772340 T2072 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 772340 T2072 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 772341 T2072 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 772342 T2072 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 772344 T2013 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 772344 T2013 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 772345 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 772628 T2013 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 772632 T2013 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58592
[junit4:junit4] 2> 772632 T2013 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 772633 T2013 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 772634 T2013 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369790432146
[junit4:junit4] 2> 772634 T2013 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369790432146/solr.xml
[junit4:junit4] 2> 772635 T2013 oasc.CoreContainer.<init> New CoreContainer 251008673
[junit4:junit4] 2> 772635 T2013 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369790432146/'
[junit4:junit4] 2> 772636 T2013 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369790432146/'
[junit4:junit4] 2> 772772 T2013 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 772773 T2013 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 772774 T2013 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 772774 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 772775 T2013 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 772775 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 772776 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 772776 T2013 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 772777 T2013 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 772778 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 772796 T2013 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 772797 T2013 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58575/solr
[junit4:junit4] 2> 772798 T2013 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 772799 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 772802 T2085 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d1b8392 name:ZooKeeperConnection Watcher:127.0.0.1:58575 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 772803 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 772816 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 772830 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 772833 T2087 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8d899db name:ZooKeeperConnection Watcher:127.0.0.1:58575/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 772833 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 772843 T2013 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 773818 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 773819 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:58588__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58588_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58588"}
[junit4:junit4] 2> 773847 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 773847 T2013 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58592_
[junit4:junit4] 2> 773847 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 773847 T2087 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 773847 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 773847 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 773932 T2013 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58592_
[junit4:junit4] 2> 773935 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 773935 T2087 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 773935 T2055 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 773935 T2035 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 773935 T2042 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 773936 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 773936 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 773937 T2071 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 773936 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 773937 T2087 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 773943 T2088 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369790432146/collection1
[junit4:junit4] 2> 773944 T2088 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 773944 T2088 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 773945 T2088 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 773946 T2088 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369790432146/collection1/'
[junit4:junit4] 2> 773948 T2088 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369790432146/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 773948 T2088 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369790432146/collection1/lib/README' to classloader
[junit4:junit4] 2> 774000 T2088 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 774060 T2088 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 774162 T2088 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 774169 T2088 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 774808 T2088 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 774812 T2088 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 774814 T2088 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 774819 T2088 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 774846 T2088 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 774846 T2088 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369790432146/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/
[junit4:junit4] 2> 774847 T2088 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@596d444a
[junit4:junit4] 2> 774847 T2088 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 774848 T2088 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3
[junit4:junit4] 2> 774849 T2088 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index/
[junit4:junit4] 2> 774849 T2088 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 774850 T2088 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index
[junit4:junit4] 2> 774853 T2088 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6979b657 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7691a6f1),segFN=segments_1,generation=1}
[junit4:junit4] 2> 774854 T2088 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 774857 T2088 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 774858 T2088 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 774858 T2088 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 774859 T2088 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 774860 T2088 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 774860 T2088 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 774860 T2088 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 774861 T2088 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 774862 T2088 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 774878 T2088 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 774886 T2088 oass.SolrIndexSearcher.<init> Opening Searcher@343d7e64 main
[junit4:junit4] 2> 774886 T2088 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/tlog
[junit4:junit4] 2> 774888 T2088 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 774888 T2088 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 774893 T2089 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@343d7e64 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 774895 T2088 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 774895 T2088 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 775435 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 775436 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58592_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58592"}
[junit4:junit4] 2> 775437 T2036 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 775437 T2036 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 775450 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 775450 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 775450 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 775450 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 775450 T2087 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 775899 T2088 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 775899 T2088 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58592 collection:collection1 shard:shard1
[junit4:junit4] 2> 775903 T2088 oasc.ZkController.register We are http://127.0.0.1:58592/collection1/ and leader is http://127.0.0.1:58584/collection1/
[junit4:junit4] 2> 775903 T2088 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58592
[junit4:junit4] 2> 775903 T2088 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 775904 T2088 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C459 name=collection1 org.apache.solr.core.SolrCore@1955bd61 url=http://127.0.0.1:58592/collection1 node=127.0.0.1:58592_ C459_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:58592_, base_url=http://127.0.0.1:58592}
[junit4:junit4] 2> 775904 T2090 C459 P58592 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 775904 T2088 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 775905 T2090 C459 P58592 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 775906 T2090 C459 P58592 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 775906 T2090 C459 P58592 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 775906 T2013 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 775907 T2013 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 775908 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 775908 T2090 C459 P58592 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 775934 T2045 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:58592__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 776194 T2013 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 776198 T2013 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:58596
[junit4:junit4] 2> 776198 T2013 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 776199 T2013 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 776199 T2013 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369790435715
[junit4:junit4] 2> 776200 T2013 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369790435715/solr.xml
[junit4:junit4] 2> 776201 T2013 oasc.CoreContainer.<init> New CoreContainer 421828125
[junit4:junit4] 2> 776201 T2013 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369790435715/'
[junit4:junit4] 2> 776202 T2013 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369790435715/'
[junit4:junit4] 2> 776330 T2013 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 776331 T2013 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 776331 T2013 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 776332 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 776332 T2013 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 776333 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 776333 T2013 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 776334 T2013 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 776334 T2013 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 776335 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 776353 T2013 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 776354 T2013 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58575/solr
[junit4:junit4] 2> 776354 T2013 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 776356 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 776358 T2102 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55834b name:ZooKeeperConnection Watcher:127.0.0.1:58575 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 776359 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 776361 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 776375 T2013 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 776377 T2104 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c4d47e3 name:ZooKeeperConnection Watcher:127.0.0.1:58575/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 776377 T2013 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 776390 T2013 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 776955 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 776956 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:58592__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58592_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58592"}
[junit4:junit4] 2> 777000 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 777000 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 777000 T2087 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 777000 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 777000 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 777000 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 777393 T2013 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58596_
[junit4:junit4] 2> 777395 T2013 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58596_
[junit4:junit4] 2> 777398 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 777398 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 777398 T2055 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 777398 T2087 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 777399 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 777398 T2042 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 777398 T2035 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 777400 T2071 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 777400 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 777400 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 777408 T2104 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 777408 T2087 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 777414 T2105 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369790435715/collection1
[junit4:junit4] 2> 777414 T2105 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 777415 T2105 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 777415 T2105 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 777416 T2105 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369790435715/collection1/'
[junit4:junit4] 2> 777418 T2105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369790435715/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 777419 T2105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369790435715/collection1/lib/README' to classloader
[junit4:junit4] 2> 777470 T2105 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 777530 T2105 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 777631 T2105 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 777637 T2105 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 777937 T2045 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:58592__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 777937 T2045 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:58592__collection1&state=recovering&nodeName=127.0.0.1:58592_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 778202 T2105 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 778205 T2105 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 778207 T2105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 778211 T2105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 778233 T2105 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 778234 T2105 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369790435715/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4/
[junit4:junit4] 2> 778234 T2105 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@596d444a
[junit4:junit4] 2> 778234 T2105 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 778235 T2105 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4
[junit4:junit4] 2> 778235 T2105 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4/index/
[junit4:junit4] 2> 778235 T2105 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 778236 T2105 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4/index
[junit4:junit4] 2> 778239 T2105 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c67a99d lockFactory=org.apache.lucene.store.NativeFSLockFactory@42caa4ac),segFN=segments_1,generation=1}
[junit4:junit4] 2> 778239 T2105 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 778241 T2105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 778241 T2105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 778242 T2105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 778243 T2105 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 778243 T2105 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 778243 T2105 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 778243 T2105 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 778244 T2105 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 778244 T2105 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 778255 T2105 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 778260 T2105 oass.SolrIndexSearcher.<init> Opening Searcher@2392d5e3 main
[junit4:junit4] 2> 778261 T2105 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4/tlog
[junit4:junit4] 2> 778262 T2105 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 778262 T2105 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 778265 T2106 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2392d5e3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 778267 T2105 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 778267 T2105 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 778504 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 778505 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58596_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58596"}
[junit4:junit4] 2> 778505 T2036 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 778506 T2036 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 778520 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 778520 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 778520 T2087 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 778520 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 778520 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 778520 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 779295 T2105 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 779295 T2105 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58596 collection:collection1 shard:shard2
[junit4:junit4] 2> 779299 T2105 oasc.ZkController.register We are http://127.0.0.1:58596/collection1/ and leader is http://127.0.0.1:58588/collection1/
[junit4:junit4] 2> 779299 T2105 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58596
[junit4:junit4] 2> 779299 T2105 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 779300 T2105 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C460 name=collection1 org.apache.solr.core.SolrCore@713f3b00 url=http://127.0.0.1:58596/collection1 node=127.0.0.1:58596_ C460_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:58596_, base_url=http://127.0.0.1:58596}
[junit4:junit4] 2> 779300 T2107 C460 P58596 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 779300 T2105 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 779301 T2107 C460 P58596 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 779302 T2107 C460 P58596 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 779302 T2107 C460 P58596 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 779303 T2013 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 779304 T2013 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 779304 T2107 C460 P58596 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 779304 T2013 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 779334 T2013 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 779335 T2061 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:58596__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 779335 T2013 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 779336 T2013 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 779337 T2013 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C461 name=collection1 org.apache.solr.core.SolrCore@1955bd61 url=http://127.0.0.1:58592/collection1 node=127.0.0.1:58592_ C461_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:58592_, base_url=http://127.0.0.1:58592}
[junit4:junit4] 2> 779939 T2090 C461 P58592 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:58584/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 779939 T2090 C461 P58592 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:58592 START replicas=[http://127.0.0.1:58584/collection1/] nUpdates=100
[junit4:junit4] 2> 779940 T2090 C461 P58592 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 779941 T2090 C461 P58592 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 779941 T2090 C461 P58592 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 779941 T2090 C461 P58592 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 779941 T2090 C461 P58592 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 779941 T2090 C461 P58592 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:58584/collection1/. core=collection1
[junit4:junit4] 2> 779942 T2090 C461 P58592 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C462 name=collection1 org.apache.solr.core.SolrCore@4549c4e5 url=http://127.0.0.1:58584/collection1 node=127.0.0.1:58584_ C462_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58584_, base_url=http://127.0.0.1:58584, leader=true}
[junit4:junit4] 2> 779949 T2046 C462 P58584 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 779956 T2047 C462 P58584 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 779959 T2047 C462 P58584 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b309ea7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54bb2ac6),segFN=segments_1,generation=1}
[junit4:junit4] 2> 779960 T2047 C462 P58584 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 779961 T2047 C462 P58584 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b309ea7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54bb2ac6),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b309ea7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54bb2ac6),segFN=segments_2,generation=2}
[junit4:junit4] 2> 779961 T2047 C462 P58584 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 779962 T2047 C462 P58584 oass.SolrIndexSearcher.<init> Opening Searcher@407964ee realtime
[junit4:junit4] 2> 779962 T2047 C462 P58584 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 779963 T2047 C462 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 779964 T2090 C461 P58592 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 779964 T2090 C461 P58592 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 779966 T2048 C462 P58584 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 779967 T2048 C462 P58584 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 779967 T2090 C461 P58592 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 779968 T2090 C461 P58592 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 779968 T2090 C461 P58592 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 779970 T2048 C462 P58584 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 779971 T2090 C461 P58592 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 779972 T2090 C461 P58592 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index.20130528182039753
[junit4:junit4] 2> 779972 T2090 C461 P58592 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@17032a5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@3cbb770e) fullCopy=false
[junit4:junit4] 2> 779975 T2048 C462 P58584 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 779977 T2090 C461 P58592 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 779977 T2090 C461 P58592 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 779978 T2090 C461 P58592 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 779980 T2090 C461 P58592 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6979b657 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7691a6f1),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6979b657 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7691a6f1),segFN=segments_2,generation=2}
[junit4:junit4] 2> 779980 T2090 C461 P58592 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 779981 T2090 C461 P58592 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 779981 T2090 C461 P58592 oass.SolrIndexSearcher.<init> Opening Searcher@9ad082c main
[junit4:junit4] 2> 779982 T2089 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9ad082c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 779983 T2090 C461 P58592 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index.20130528182039753 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index.20130528182039753;done=true>>]
[junit4:junit4] 2> 779983 T2090 C461 P58592 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index.20130528182039753
[junit4:junit4] 2> 779983 T2090 C461 P58592 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index.20130528182039753
[junit4:junit4] 2> 779984 T2090 C461 P58592 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 779984 T2090 C461 P58592 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 779984 T2090 C461 P58592 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 779984 T2090 C461 P58592 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 780012 T2090 C461 P58592 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 780024 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 780025 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:58596__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58596_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58596"}
[junit4:junit4] 2> 780030 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:58592__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58592_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58592"}
[junit4:junit4] 2> 780043 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 780043 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 780043 T2087 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 780043 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 780043 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 780043 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 780337 T2061 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:58596__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 780337 T2061 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:58596__collection1&state=recovering&nodeName=127.0.0.1:58596_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 780339 T2013 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 781341 T2013 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C460_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:58596_, base_url=http://127.0.0.1:58596}
[junit4:junit4] 2> 782339 T2107 C460 P58596 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:58588/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 782339 T2107 C460 P58596 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:58596 START replicas=[http://127.0.0.1:58588/collection1/] nUpdates=100
[junit4:junit4] 2> 782340 T2107 C460 P58596 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 782340 T2107 C460 P58596 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 782340 T2107 C460 P58596 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 782340 T2107 C460 P58596 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 782341 T2107 C460 P58596 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 782341 T2107 C460 P58596 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:58588/collection1/. core=collection1
[junit4:junit4] 2> 782341 T2107 C460 P58596 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 782344 T2013 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C463 name=collection1 org.apache.solr.core.SolrCore@6df82244 url=http://127.0.0.1:58588/collection1 node=127.0.0.1:58588_ C463_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58588_, base_url=http://127.0.0.1:58588, leader=true}
[junit4:junit4] 2> 782349 T2062 C463 P58588 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 782356 T2063 C463 P58588 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 782359 T2063 C463 P58588 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ee1e101 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb11f3d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 782360 T2063 C463 P58588 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 782361 T2063 C463 P58588 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ee1e101 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb11f3d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ee1e101 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb11f3d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 782361 T2063 C463 P58588 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 782362 T2063 C463 P58588 oass.SolrIndexSearcher.<init> Opening Searcher@1186885b realtime
[junit4:junit4] 2> 782362 T2063 C463 P58588 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 782363 T2063 C463 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 782364 T2107 C460 P58596 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 782364 T2107 C460 P58596 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 782366 T2064 C463 P58588 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 782367 T2064 C463 P58588 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 782367 T2107 C460 P58596 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 782368 T2107 C460 P58596 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 782368 T2107 C460 P58596 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 782370 T2064 C463 P58588 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 782371 T2107 C460 P58596 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 782372 T2107 C460 P58596 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4/index.20130528182042153
[junit4:junit4] 2> 782372 T2107 C460 P58596 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@35bf97fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@1745f719) fullCopy=false
[junit4:junit4] 2> 782375 T2064 C463 P58588 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C464 name=collection1 org.apache.solr.core.SolrCore@713f3b00 url=http://127.0.0.1:58596/collection1 node=127.0.0.1:58596_ C464_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:58596_, base_url=http://127.0.0.1:58596}
[junit4:junit4] 2> 782395 T2107 C464 P58596 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 782397 T2107 C464 P58596 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 782397 T2107 C464 P58596 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 782399 T2107 C464 P58596 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c67a99d lockFactory=org.apache.lucene.store.NativeFSLockFactory@42caa4ac),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c67a99d lockFactory=org.apache.lucene.store.NativeFSLockFactory@42caa4ac),segFN=segments_2,generation=2}
[junit4:junit4] 2> 782400 T2107 C464 P58596 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 782400 T2107 C464 P58596 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 782401 T2107 C464 P58596 oass.SolrIndexSearcher.<init> Opening Searcher@6c24ae1d main
[junit4:junit4] 2> 782402 T2106 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c24ae1d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 782403 T2107 C464 P58596 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4/index.20130528182042153 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4/index.20130528182042153;done=true>>]
[junit4:junit4] 2> 782403 T2107 C464 P58596 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4/index.20130528182042153
[junit4:junit4] 2> 782404 T2107 C464 P58596 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty4/index.20130528182042153
[junit4:junit4] 2> 782404 T2107 C464 P58596 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 782404 T2107 C464 P58596 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 782404 T2107 C464 P58596 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 782405 T2107 C464 P58596 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 782407 T2107 C464 P58596 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 783059 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 783060 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:58596__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:58596_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:58596"}
[junit4:junit4] 2> 783075 T2042 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 783075 T2087 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 783075 T2055 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 783075 T2071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 783075 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 783075 T2035 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 783346 T2013 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 783348 T2013 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C465 name=collection1 org.apache.solr.core.SolrCore@89ae2d3 url=http://127.0.0.1:58578/collection1 node=127.0.0.1:58578_ C465_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:58578_, base_url=http://127.0.0.1:58578, leader=true}
[junit4:junit4] 2> 783356 T2025 C465 P58578 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 783359 T2025 C465 P58578 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4fd3a6e lockFactory=org.apache.lucene.store.NativeFSLockFactory@664f83d6),segFN=segments_1,generation=1}
[junit4:junit4] 2> 783360 T2025 C465 P58578 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 783360 T2025 C465 P58578 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4fd3a6e lockFactory=org.apache.lucene.store.NativeFSLockFactory@664f83d6),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4fd3a6e lockFactory=org.apache.lucene.store.NativeFSLockFactory@664f83d6),segFN=segments_2,generation=2}
[junit4:junit4] 2> 783361 T2025 C465 P58578 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 783361 T2025 C465 P58578 oass.SolrIndexSearcher.<init> Opening Searcher@1536d07e main
[junit4:junit4] 2> 783362 T2025 C465 P58578 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 783363 T2039 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1536d07e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 783364 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> ASYNC NEW_CORE C466 name=collection1 org.apache.solr.core.SolrCore@4549c4e5 url=http://127.0.0.1:58584/collection1 node=127.0.0.1:58584_ C466_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58584_, base_url=http://127.0.0.1:58584, leader=true}
[junit4:junit4] 2> 783377 T2049 C466 P58584 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 783377 T2049 C466 P58584 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b309ea7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54bb2ac6),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b309ea7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54bb2ac6),segFN=segments_3,generation=3}
[junit4:junit4] 2> 783378 T2049 C466 P58584 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 783378 T2049 C466 P58584 oass.SolrIndexSearcher.<init> Opening Searcher@555b4be6 main
[junit4:junit4] 2> 783379 T2049 C466 P58584 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 783380 T2057 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@555b4be6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 783380 T2049 C466 P58584 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:58592/collection1/, StdNode: http://127.0.0.1:58588/collection1/, StdNode: http://127.0.0.1:58596/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> ASYNC NEW_CORE C467 name=collection1 org.apache.solr.core.SolrCore@6df82244 url=http://127.0.0.1:58588/collection1 node=127.0.0.1:58588_ C467_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58588_, base_url=http://127.0.0.1:58588, leader=true}
[junit4:junit4] 2> 783383 T2065 C467 P58588 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 783384 T2065 C467 P58588 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ee1e101 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb11f3d),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ee1e101 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3fb11f3d),segFN=segments_3,generation=3}
[junit4:junit4] 2> 783384 T2065 C467 P58588 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 783385 T2065 C467 P58588 oass.SolrIndexSearcher.<init> Opening Searcher@2167e531 main
[junit4:junit4] 2> 783386 T2065 C467 P58588 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 783386 T2073 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2167e531 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 783387 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> C464_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58596_, base_url=http://127.0.0.1:58596}
[junit4:junit4] 2> 783390 T2094 C464 P58596 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C468 name=collection1 org.apache.solr.core.SolrCore@1955bd61 url=http://127.0.0.1:58592/collection1 node=127.0.0.1:58592_ C468_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58592_, base_url=http://127.0.0.1:58592}
[junit4:junit4] 2> 783391 T2077 C468 P58592 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 783391 T2094 C464 P58596 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c67a99d lockFactory=org.apache.lucene.store.NativeFSLockFactory@42caa4ac),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c67a99d lockFactory=org.apache.lucene.store.NativeFSLockFactory@42caa4ac),segFN=segments_3,generation=3}
[junit4:junit4] 2> 783392 T2077 C468 P58592 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6979b657 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7691a6f1),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6979b657 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7691a6f1),segFN=segments_3,generation=3}
[junit4:junit4] 2> 783392 T2094 C464 P58596 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 783393 T2077 C468 P58592 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 783393 T2094 C464 P58596 oass.SolrIndexSearcher.<init> Opening Searcher@284c93d7 main
[junit4:junit4] 2> 783394 T2077 C468 P58592 oass.SolrIndexSearcher.<init> Opening Searcher@323119cf main
[junit4:junit4] 2> 783394 T2094 C464 P58596 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 783395 T2077 C468 P58592 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 783395 T2089 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@323119cf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 783395 T2106 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@284c93d7 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 783396 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 783396 T2094 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 783397 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 20
[junit4:junit4] 2> 783398 T2013 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 783401 T2050 C466 P58584 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 783403 T2078 C468 P58592 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 783405 T2066 C467 P58588 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 783407 T2095 C464 P58596 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 785413 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436329385859743744)} 0 2
[junit4:junit4] 2> 785422 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1436329385863938048&update.from=http://127.0.0.1:58584/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436329385863938048)} 0 2
[junit4:junit4] 2> 785426 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1436329385868132352&update.from=http://127.0.0.1:58588/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436329385868132352)} 0 2
[junit4:junit4] 2> 785427 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1436329385868132352)} 0 7
[junit4:junit4] 2> 785427 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436329385863938048)} 0 11
[junit4:junit4] 2> 785431 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1436329385878618112)]} 0 1
[junit4:junit4] 2> 785437 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1436329385881763840)]} 0 1
[junit4:junit4] 2> 785437 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1436329385881763840)]} 0 4
[junit4:junit4] 2> 785440 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1436329385889103872)]} 0 0
[junit4:junit4] 2> 785448 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1436329385893298176)]} 0 1
[junit4:junit4] 2> 785448 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!1 (1436329385893298176)]} 0 4
[junit4:junit4] 2> 785449 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1]} 0 6
[junit4:junit4] 2> 785452 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1436329385901686784)]} 0 0
[junit4:junit4] 2> 785460 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1436329385906929664)]} 0 0
[junit4:junit4] 2> 785461 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1436329385906929664)]} 0 4
[junit4:junit4] 2> 785462 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2]} 0 7
[junit4:junit4] 2> 785465 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1436329385915318272)]} 0 0
[junit4:junit4] 2> 785473 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1436329385920561152)]} 0 0
[junit4:junit4] 2> 785474 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!3 (1436329385920561152)]} 0 4
[junit4:junit4] 2> 785475 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3]} 0 7
[junit4:junit4] 2> 785478 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1436329385928949760)]} 0 0
[junit4:junit4] 2> 785487 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1436329385934192640)]} 0 0
[junit4:junit4] 2> 785487 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1436329385934192640)]} 0 4
[junit4:junit4] 2> 785488 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4]} 0 7
[junit4:junit4] 2> 785492 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1436329385942581248)]} 0 1
[junit4:junit4] 2> 785499 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1436329385947824128)]} 0 0
[junit4:junit4] 2> 785500 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1436329385947824128)]} 0 4
[junit4:junit4] 2> 785501 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5]} 0 7
[junit4:junit4] 2> 785504 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1436329385956212736)]} 0 0
[junit4:junit4] 2> 785510 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1436329385959358464)]} 0 0
[junit4:junit4] 2> 785511 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1436329385959358464)]} 0 4
[junit4:junit4] 2> 785514 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1436329385966698496)]} 0 0
[junit4:junit4] 2> 785522 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1436329385971941376)]} 0 0
[junit4:junit4] 2> 785523 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1436329385971941376)]} 0 4
[junit4:junit4] 2> 785524 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7]} 0 7
[junit4:junit4] 2> 785526 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1436329385979281408)]} 0 0
[junit4:junit4] 2> 785534 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1436329385984524288)]} 0 0
[junit4:junit4] 2> 785535 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!8 (1436329385984524288)]} 0 4
[junit4:junit4] 2> 785536 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8]} 0 7
[junit4:junit4] 2> 785539 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1436329385992912896)]} 0 0
[junit4:junit4] 2> 785545 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1436329385996058624)]} 0 0
[junit4:junit4] 2> 785546 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1436329385996058624)]} 0 4
[junit4:junit4] 2> 785549 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1436329386003398656)]} 0 0
[junit4:junit4] 2> 785555 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1436329386006544384)]} 0 0
[junit4:junit4] 2> 785556 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1436329386006544384)]} 0 4
[junit4:junit4] 2> 785559 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1436329386013884416)]} 0 0
[junit4:junit4] 2> 785567 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1436329386019127296)]} 0 0
[junit4:junit4] 2> 785568 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1436329386019127296)]} 0 4
[junit4:junit4] 2> 785569 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11]} 0 7
[junit4:junit4] 2> 785572 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1436329386027515904)]} 0 0
[junit4:junit4] 2> 785580 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1436329386032758784)]} 0 0
[junit4:junit4] 2> 785581 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1436329386032758784)]} 0 4
[junit4:junit4] 2> 785582 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12]} 0 7
[junit4:junit4] 2> 785585 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1436329386041147392)]} 0 0
[junit4:junit4] 2> 785593 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1436329386046390272)]} 0 0
[junit4:junit4] 2> 785594 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1436329386046390272)]} 0 4
[junit4:junit4] 2> 785595 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13]} 0 7
[junit4:junit4] 2> 785598 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1436329386054778880)]} 0 0
[junit4:junit4] 2> 785604 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1436329386057924608)]} 0 0
[junit4:junit4] 2> 785605 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1436329386057924608)]} 0 4
[junit4:junit4] 2> 785608 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1436329386065264640)]} 0 0
[junit4:junit4] 2> 785614 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1436329386068410368)]} 0 0
[junit4:junit4] 2> 785615 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1436329386068410368)]} 0 4
[junit4:junit4] 2> 785618 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1436329386075750400)]} 0 0
[junit4:junit4] 2> 785626 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1436329386080993280)]} 0 0
[junit4:junit4] 2> 785627 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1436329386080993280)]} 0 4
[junit4:junit4] 2> 785628 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16]} 0 7
[junit4:junit4] 2> 785631 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1436329386089381888)]} 0 0
[junit4:junit4] 2> 785639 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1436329386094624768)]} 0 0
[junit4:junit4] 2> 785640 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!17 (1436329386094624768)]} 0 4
[junit4:junit4] 2> 785641 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17]} 0 7
[junit4:junit4] 2> 785644 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1436329386103013376)]} 0 0
[junit4:junit4] 2> 785650 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1436329386106159104)]} 0 0
[junit4:junit4] 2> 785651 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1436329386106159104)]} 0 4
[junit4:junit4] 2> 785654 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1436329386113499136)]} 0 0
[junit4:junit4] 2> 785660 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1436329386116644864)]} 0 0
[junit4:junit4] 2> 785661 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1436329386116644864)]} 0 4
[junit4:junit4] 2> 785664 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1436329386123984896)]} 0 0
[junit4:junit4] 2> 785672 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1436329386129227776)]} 0 0
[junit4:junit4] 2> 785673 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1436329386129227776)]} 0 4
[junit4:junit4] 2> 785674 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 7
[junit4:junit4] 2> 785677 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1436329386137616384)]} 0 0
[junit4:junit4] 2> 785683 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1436329386140762112)]} 0 0
[junit4:junit4] 2> 785684 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1436329386140762112)]} 0 4
[junit4:junit4] 2> 785687 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1436329386148102144)]} 0 0
[junit4:junit4] 2> 785693 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1436329386151247872)]} 0 0
[junit4:junit4] 2> 785694 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1436329386151247872)]} 0 4
[junit4:junit4] 2> 785697 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1436329386158587904)]} 0 0
[junit4:junit4] 2> 785705 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1436329386163830784)]} 0 0
[junit4:junit4] 2> 785706 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1436329386163830784)]} 0 4
[junit4:junit4] 2> 785707 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23]} 0 7
[junit4:junit4] 2> 785709 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1436329386171170816)]} 0 0
[junit4:junit4] 2> 785717 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1436329386176413696)]} 0 0
[junit4:junit4] 2> 785718 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1436329386176413696)]} 0 4
[junit4:junit4] 2> 785719 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24]} 0 7
[junit4:junit4] 2> 785722 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1436329386184802304)]} 0 0
[junit4:junit4] 2> 785731 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1436329386190045184)]} 0 1
[junit4:junit4] 2> 785732 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1436329386190045184)]} 0 5
[junit4:junit4] 2> 785732 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25]} 0 7
[junit4:junit4] 2> 785736 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1436329386198433792)]} 0 1
[junit4:junit4] 2> 785745 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1436329386205773824)]} 0 0
[junit4:junit4] 2> 785746 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!26 (1436329386205773824)]} 0 4
[junit4:junit4] 2> 785747 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26]} 0 8
[junit4:junit4] 2> 785750 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1436329386214162432)]} 0 0
[junit4:junit4] 2> 785759 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1436329386220453888)]} 0 0
[junit4:junit4] 2> 785760 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1436329386220453888)]} 0 4
[junit4:junit4] 2> 785761 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 8
[junit4:junit4] 2> 785764 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1436329386228842496)]} 0 0
[junit4:junit4] 2> 785772 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1436329386234085376)]} 0 0
[junit4:junit4] 2> 785773 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1436329386234085376)]} 0 4
[junit4:junit4] 2> 785774 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 7
[junit4:junit4] 2> 785777 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1436329386242473984)]} 0 0
[junit4:junit4] 2> 785783 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1436329386245619712)]} 0 0
[junit4:junit4] 2> 785784 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1436329386245619712)]} 0 4
[junit4:junit4] 2> 785787 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1436329386252959744)]} 0 0
[junit4:junit4] 2> 785793 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1436329386256105472)]} 0 0
[junit4:junit4] 2> 785794 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1436329386256105472)]} 0 4
[junit4:junit4] 2> 785797 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1436329386263445504)]} 0 0
[junit4:junit4] 2> 785803 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1436329386266591232)]} 0 0
[junit4:junit4] 2> 785804 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1436329386266591232)]} 0 4
[junit4:junit4] 2> 785807 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1436329386273931264)]} 0 0
[junit4:junit4] 2> 785813 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1436329386277076992)]} 0 0
[junit4:junit4] 2> 785814 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1436329386277076992)]} 0 4
[junit4:junit4] 2> 785817 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1436329386284417024)]} 0 0
[junit4:junit4] 2> 785825 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1436329386289659904)]} 0 0
[junit4:junit4] 2> 785826 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1436329386289659904)]} 0 4
[junit4:junit4] 2> 785827 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33]} 0 7
[junit4:junit4] 2> 785831 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1436329386298048512)]} 0 1
[junit4:junit4] 2> 785839 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1436329386303291392)]} 0 1
[junit4:junit4] 2> 785839 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1436329386303291392)]} 0 4
[junit4:junit4] 2> 785840 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34]} 0 7
[junit4:junit4] 2> 785843 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1436329386311680000)]} 0 0
[junit4:junit4] 2> 785850 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1436329386314825728)]} 0 1
[junit4:junit4] 2> 785850 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1436329386314825728)]} 0 4
[junit4:junit4] 2> 785854 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1436329386322165760)]} 0 1
[junit4:junit4] 2> 785861 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1436329386327408640)]} 0 0
[junit4:junit4] 2> 785862 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1436329386327408640)]} 0 4
[junit4:junit4] 2> 785863 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36]} 0 7
[junit4:junit4] 2> 785866 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1436329386335797248)]} 0 0
[junit4:junit4] 2> 785874 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1436329386341040128)]} 0 0
[junit4:junit4] 2> 785875 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1436329386341040128)]} 0 4
[junit4:junit4] 2> 785876 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37]} 0 7
[junit4:junit4] 2> 785880 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1436329386349428736)]} 0 1
[junit4:junit4] 2> 785885 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1436329386352574464)]} 0 0
[junit4:junit4] 2> 785886 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1436329386352574464)]} 0 4
[junit4:junit4] 2> 785889 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1436329386359914496)]} 0 0
[junit4:junit4] 2> 785895 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1436329386363060224)]} 0 0
[junit4:junit4] 2> 785896 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1436329386363060224)]} 0 4
[junit4:junit4] 2> 785899 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1436329386370400256)]} 0 0
[junit4:junit4] 2> 785907 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1436329386375643136)]} 0 0
[junit4:junit4] 2> 785908 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1436329386375643136)]} 0 4
[junit4:junit4] 2> 785909 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40]} 0 7
[junit4:junit4] 2> 785911 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1436329386382983168)]} 0 0
[junit4:junit4] 2> 785919 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1436329386388226048)]} 0 0
[junit4:junit4] 2> 785920 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!41 (1436329386388226048)]} 0 4
[junit4:junit4] 2> 785921 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41]} 0 7
[junit4:junit4] 2> 785923 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1436329386395566080)]} 0 0
[junit4:junit4] 2> 785929 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1436329386398711808)]} 0 0
[junit4:junit4] 2> 785930 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1436329386398711808)]} 0 4
[junit4:junit4] 2> 785933 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1436329386406051840)]} 0 0
[junit4:junit4] 2> 785942 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1436329386411294720)]} 0 1
[junit4:junit4] 2> 785942 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!43 (1436329386411294720)]} 0 4
[junit4:junit4] 2> 785943 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43]} 0 7
[junit4:junit4] 2> 785947 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1436329386419683328)]} 0 1
[junit4:junit4] 2> 785954 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1436329386424926208)]} 0 0
[junit4:junit4] 2> 785955 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!44 (1436329386424926208)]} 0 4
[junit4:junit4] 2> 785956 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44]} 0 7
[junit4:junit4] 2> 785960 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1436329386433314816)]} 0 1
[junit4:junit4] 2> 785968 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1436329386439606272)]} 0 0
[junit4:junit4] 2> 785969 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!45 (1436329386439606272)]} 0 4
[junit4:junit4] 2> 785970 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45]} 0 7
[junit4:junit4] 2> 785973 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1436329386447994880)]} 0 0
[junit4:junit4] 2> 785979 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1436329386451140608)]} 0 0
[junit4:junit4] 2> 785980 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1436329386451140608)]} 0 4
[junit4:junit4] 2> 785983 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1436329386458480640)]} 0 0
[junit4:junit4] 2> 785989 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1436329386461626368)]} 0 0
[junit4:junit4] 2> 785990 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1436329386461626368)]} 0 4
[junit4:junit4] 2> 785993 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1436329386468966400)]} 0 0
[junit4:junit4] 2> 786001 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1436329386474209280)]} 0 0
[junit4:junit4] 2> 786002 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!48 (1436329386474209280)]} 0 4
[junit4:junit4] 2> 786003 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48]} 0 7
[junit4:junit4] 2> 786005 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1436329386481549312)]} 0 0
[junit4:junit4] 2> 786011 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1436329386484695040)]} 0 0
[junit4:junit4] 2> 786012 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1436329386484695040)]} 0 4
[junit4:junit4] 2> 786015 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1436329386492035072)]} 0 0
[junit4:junit4] 2> 786021 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1436329386495180800)]} 0 0
[junit4:junit4] 2> 786022 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1436329386495180800)]} 0 4
[junit4:junit4] 2> 786025 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1436329386502520832)]} 0 0
[junit4:junit4] 2> 786033 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1436329386507763712)]} 0 0
[junit4:junit4] 2> 786034 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!51 (1436329386507763712)]} 0 4
[junit4:junit4] 2> 786035 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51]} 0 7
[junit4:junit4] 2> 786039 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1436329386516152320)]} 0 1
[junit4:junit4] 2> 786047 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1436329386521395200)]} 0 0
[junit4:junit4] 2> 786047 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!52 (1436329386521395200)]} 0 4
[junit4:junit4] 2> 786048 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52]} 0 7
[junit4:junit4] 2> 786051 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1436329386529783808)]} 0 0
[junit4:junit4] 2> 786059 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1436329386535026688)]} 0 0
[junit4:junit4] 2> 786060 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1436329386535026688)]} 0 4
[junit4:junit4] 2> 786061 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53]} 0 7
[junit4:junit4] 2> 786064 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1436329386543415296)]} 0 0
[junit4:junit4] 2> 786072 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1436329386548658176)]} 0 0
[junit4:junit4] 2> 786073 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!54 (1436329386548658176)]} 0 4
[junit4:junit4] 2> 786074 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54]} 0 7
[junit4:junit4] 2> 786076 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1436329386555998208)]} 0 0
[junit4:junit4] 2> 786082 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1436329386559143936)]} 0 0
[junit4:junit4] 2> 786083 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1436329386559143936)]} 0 4
[junit4:junit4] 2> 786086 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1436329386566483968)]} 0 0
[junit4:junit4] 2> 786092 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1436329386569629696)]} 0 0
[junit4:junit4] 2> 786093 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1436329386569629696)]} 0 4
[junit4:junit4] 2> 786097 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1436329386578018304)]} 0 0
[junit4:junit4] 2> 786105 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1436329386583261184)]} 0 0
[junit4:junit4] 2> 786106 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1436329386583261184)]} 0 4
[junit4:junit4] 2> 786107 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57]} 0 7
[junit4:junit4] 2> 786110 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1436329386590601216)]} 0 1
[junit4:junit4] 2> 786119 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1436329386596892672)]} 0 1
[junit4:junit4] 2> 786119 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1436329386596892672)]} 0 4
[junit4:junit4] 2> 786120 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58]} 0 7
[junit4:junit4] 2> 786124 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1436329386605281280)]} 0 1
[junit4:junit4] 2> 786131 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1436329386610524160)]} 0 0
[junit4:junit4] 2> 786132 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!59 (1436329386610524160)]} 0 4
[junit4:junit4] 2> 786133 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59]} 0 7
[junit4:junit4] 2> 786136 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1436329386618912768)]} 0 0
[junit4:junit4] 2> 786142 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1436329386622058496)]} 0 0
[junit4:junit4] 2> 786143 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1436329386622058496)]} 0 4
[junit4:junit4] 2> 786146 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1436329386629398528)]} 0 0
[junit4:junit4] 2> 786152 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1436329386632544256)]} 0 0
[junit4:junit4] 2> 786153 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1436329386632544256)]} 0 4
[junit4:junit4] 2> 786156 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1436329386639884288)]} 0 0
[junit4:junit4] 2> 786164 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1436329386645127168)]} 0 0
[junit4:junit4] 2> 786165 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!62 (1436329386645127168)]} 0 4
[junit4:junit4] 2> 786166 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62]} 0 7
[junit4:junit4] 2> 786168 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1436329386652467200)]} 0 0
[junit4:junit4] 2> 786174 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1436329386655612928)]} 0 0
[junit4:junit4] 2> 786175 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1436329386655612928)]} 0 4
[junit4:junit4] 2> 786178 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1436329386662952960)]} 0 0
[junit4:junit4] 2> 786186 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1436329386668195840)]} 0 0
[junit4:junit4] 2> 786187 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!64 (1436329386668195840)]} 0 4
[junit4:junit4] 2> 786188 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64]} 0 7
[junit4:junit4] 2> 786191 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1436329386676584448)]} 0 0
[junit4:junit4] 2> 786199 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1436329386681827328)]} 0 0
[junit4:junit4] 2> 786200 T2051 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!65 (1436329386681827328)]} 0 4
[junit4:junit4] 2> 786201 T2067 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65]} 0 7
[junit4:junit4] 2> 786204 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1436329386689167360)]} 0 1
[junit4:junit4] 2> 786211 T2096 C464 P58596 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58588/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1436329386694410240)]} 0 0
[junit4:junit4] 2> 786212 T2065 C467 P58588 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:58584/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1436329386694410240)]} 0 4
[junit4:junit4] 2> 786213 T2049 C466 P58584 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66]} 0 7
[junit4:junit4] 2> 786216 T2025 C465 P58578 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1436329386702798848)]} 0 0
[junit4:junit4] 2> 786222 T2077 C468 P58592 oasup.LogUpdateProcessor.finish [collection1] w
[...truncated too long message...]
sts-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-1369790419002 FAILED !!!!!
[junit4:junit4] 2> 796359 T2013 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 796359 T2013 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:58575 58575
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=C231A6167E827A75 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ms_MY -Dtests.timezone=America/Creston -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 37.2s J0 | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:58584 returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([C231A6167E827A75:43D7280E09DD1A49]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 796392 T2013 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 822864 T2087 oasu.PeerSync.handleResponse WARN PeerSync: core=collection1 url=http://127.0.0.1:58592 couldn't connect to http://127.0.0.1:58584/collection1/, counting as success
[junit4:junit4] 2> 822864 T2087 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:58592 DONE. sync succeeded
[junit4:junit4] 2> 822865 T2087 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 822865 T2087 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4:junit4] 2> 822866 T2087 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1955bd61
[junit4:junit4] 2> 822867 T2087 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=15,adds=15,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=74,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 822867 T2087 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 822867 T2087 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 822868 T2087 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> ASYNC NEW_CORE C481 name=collection1 org.apache.solr.core.SolrCore@1955bd61 url=http://127.0.0.1:58592/collection1 node=127.0.0.1:58592_ C481_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:58592_, base_url=http://127.0.0.1:58592}
[junit4:junit4] 2> 822870 T2087 C481 P58592 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6979b657 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7691a6f1),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6979b657 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7691a6f1),segFN=segments_5,generation=5}
[junit4:junit4] 2> 822870 T2087 C481 P58592 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 822873 T2087 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 822874 T2087 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 822874 T2087 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3;done=false>>]
[junit4:junit4] 2> 822874 T2087 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3
[junit4:junit4] 2> 822875 T2087 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index;done=false>>]
[junit4:junit4] 2> 822875 T2087 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369790419002/jetty3/index
[junit4:junit4] 2> 822875 T2087 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 822875 T2087 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 822876 T2087 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 822876 T2087 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 822876 T2087 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 822876 T2087 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ms_MY, timezone=America/Creston
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=346919168,total=535822336
[junit4:junit4] 2> NOTE: All tests run in this JVM: [UpdateRequestProcessorFactoryTest, AliasIntegrationTest, TestDocumentBuilder, ChaosMonkeyShardSplitTest, TestUniqueKeyFieldResource, TestSolrIndexConfig, PreAnalyzedFieldTest, TestCloudManagedSchema, ScriptEngineTest, LeaderElectionTest, UUIDFieldTest, SolrIndexSplitterTest, QueryResultKeyTest, TestReplicationHandler, BasicDistributedZkTest, MinimalSchemaTest, RegexBoostProcessorTest, TermVectorComponentTest, BinaryUpdateRequestHandlerTest, CircularListTest, SearchHandlerTest, TestValueSourceCache, PolyFieldTest, FileBasedSpellCheckerTest, LegacyHTMLStripCharFilterTest, AlternateDirectoryTest, TestSearchPerf, TestGroupingSearch, TestFastWriter, TestSolrCoreProperties, DirectSolrConnectionTest, TestFaceting, BadCopyFieldTest, SpellingQueryConverterTest, TestLFUCache, TestPseudoReturnFields, CSVRequestHandlerTest, CacheHeaderTest, PeerSyncTest, SliceStateTest, TestSolrQueryParser, DocumentBuilderTest, TestCharFilters, ShowFileRequestHandlerTest, ShardSplitTest]
[junit4:junit4] Completed on J0 in 64.25s, 1 test, 1 error <<< FAILURES!
[...truncated 581 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:380: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:360: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1232 tests, 1 error, 13 ignored (7 assumptions)
Total time: 56 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4023 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4023/
2 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:57278 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:57278 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([EB1CA6E4AFF51C08:6AFA28FCD8AA7C34]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:63308/x_/o returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:63308/x_/o returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([EB1CA6E4AFF51C08:6AFA28FCD8AA7C34]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9330 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 244297 T797 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 244302 T797 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-ShardSplitTest-1369758154219
[junit4:junit4] 2> 244303 T797 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 244304 T798 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 244405 T797 oasc.ZkTestServer.run start zk server on port:43153
[junit4:junit4] 2> 244406 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 244413 T804 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36096231 name:ZooKeeperConnection Watcher:127.0.0.1:43153 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 244413 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 244414 T797 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 244420 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 244431 T806 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6dd2da11 name:ZooKeeperConnection Watcher:127.0.0.1:43153/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 244431 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 244432 T797 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 244435 T797 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 244445 T797 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 244447 T797 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 244450 T797 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 244476 T797 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 244490 T797 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 244491 T797 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 244495 T797 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 244496 T797 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 244498 T797 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 244498 T797 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 244508 T797 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 244509 T797 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 244511 T797 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 244512 T797 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 244515 T797 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 244515 T797 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 244518 T797 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 244518 T797 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 244526 T797 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 244527 T797 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 244728 T797 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 244732 T797 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:59486
[junit4:junit4] 2> 244732 T797 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 244732 T797 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 244733 T797 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369758154447
[junit4:junit4] 2> 244733 T797 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369758154447/solr.xml
[junit4:junit4] 2> 244733 T797 oasc.CoreContainer.<init> New CoreContainer 1369885584
[junit4:junit4] 2> 244734 T797 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369758154447/'
[junit4:junit4] 2> 244734 T797 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369758154447/'
[junit4:junit4] 2> 244829 T797 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 244829 T797 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 244830 T797 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 244830 T797 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 244830 T797 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 244831 T797 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 244831 T797 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 244831 T797 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 244832 T797 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 244832 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 244845 T797 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 244845 T797 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43153/solr
[junit4:junit4] 2> 244856 T797 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 244857 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 244859 T817 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26206e3f name:ZooKeeperConnection Watcher:127.0.0.1:43153 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 244860 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 244866 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 244880 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 244882 T819 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64533695 name:ZooKeeperConnection Watcher:127.0.0.1:43153/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 244882 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 244884 T797 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 244894 T797 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 244897 T797 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 244900 T797 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59486_
[junit4:junit4] 2> 244907 T797 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59486_
[junit4:junit4] 2> 244910 T797 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 244928 T797 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 244930 T797 oasc.Overseer.start Overseer (id=89768470395289603-127.0.0.1:59486_-n_0000000000) starting
[junit4:junit4] 2> 244943 T797 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 244955 T821 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 244955 T797 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 244957 T797 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 244959 T797 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 244961 T820 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 244970 T822 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369758154447/collection1
[junit4:junit4] 2> 244971 T822 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 244972 T822 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 244972 T822 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 244973 T822 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369758154447/collection1/'
[junit4:junit4] 2> 244974 T822 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369758154447/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 244975 T822 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369758154447/collection1/lib/README' to classloader
[junit4:junit4] 2> 245014 T822 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 245072 T822 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 245073 T822 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 245079 T822 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 245492 T822 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 245495 T822 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 245496 T822 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 245500 T822 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 245521 T822 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 245522 T822 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369758154447/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369758154218/control/data/
[junit4:junit4] 2> 245522 T822 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@430828fa
[junit4:junit4] 2> 245523 T822 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 245523 T822 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/control/data
[junit4:junit4] 2> 245523 T822 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369758154218/control/data/index/
[junit4:junit4] 2> 245524 T822 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369758154218/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 245524 T822 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/control/data/index
[junit4:junit4] 2> 245527 T822 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5700078 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3624d38a),segFN=segments_1,generation=1}
[junit4:junit4] 2> 245527 T822 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 245530 T822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 245530 T822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 245530 T822 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 245531 T822 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 245531 T822 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 245531 T822 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 245532 T822 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 245532 T822 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 245532 T822 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 245543 T822 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 245548 T822 oass.SolrIndexSearcher.<init> Opening Searcher@3bcf6ac5 main
[junit4:junit4] 2> 245548 T822 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369758154218/control/data/tlog
[junit4:junit4] 2> 245549 T822 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 245549 T822 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 245552 T823 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3bcf6ac5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 245553 T822 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 245553 T822 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 246464 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 246465 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59486_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59486"}
[junit4:junit4] 2> 246465 T820 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 246466 T820 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 246507 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 246582 T822 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 246582 T822 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59486 collection:control_collection shard:shard1
[junit4:junit4] 2> 246594 T822 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 246612 T822 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 246627 T822 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 246638 T822 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 246639 T822 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 246639 T822 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59486/collection1/
[junit4:junit4] 2> 246639 T822 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 246640 T822 oasc.SyncStrategy.syncToMe http://127.0.0.1:59486/collection1/ has no replicas
[junit4:junit4] 2> 246640 T822 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59486/collection1/
[junit4:junit4] 2> 246640 T822 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 248012 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 248032 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 248086 T822 oasc.ZkController.register We are http://127.0.0.1:59486/collection1/ and leader is http://127.0.0.1:59486/collection1/
[junit4:junit4] 2> 248086 T822 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59486
[junit4:junit4] 2> 248086 T822 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 248087 T822 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 248087 T822 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 248089 T822 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 248090 T797 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 248090 T797 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 248091 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 248104 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 248112 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 248115 T826 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5fd282 name:ZooKeeperConnection Watcher:127.0.0.1:43153/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 248115 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 248116 T797 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 248121 T797 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 248409 T797 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 248413 T797 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:57278
[junit4:junit4] 2> 248414 T797 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 248414 T797 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 248415 T797 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369758158037
[junit4:junit4] 2> 248415 T797 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369758158037/solr.xml
[junit4:junit4] 2> 248416 T797 oasc.CoreContainer.<init> New CoreContainer 430849493
[junit4:junit4] 2> 248417 T797 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369758158037/'
[junit4:junit4] 2> 248417 T797 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369758158037/'
[junit4:junit4] 2> 248551 T797 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 248552 T797 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 248553 T797 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 248553 T797 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 248554 T797 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 248554 T797 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 248555 T797 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 248555 T797 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 248556 T797 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 248556 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 248573 T797 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 248574 T797 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43153/solr
[junit4:junit4] 2> 248574 T797 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 248576 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 248580 T837 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@626ec307 name:ZooKeeperConnection Watcher:127.0.0.1:43153 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 248580 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 248595 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 248607 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 248610 T839 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74e9bb32 name:ZooKeeperConnection Watcher:127.0.0.1:43153/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 248610 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 248621 T797 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 249537 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 249538 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59486__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59486_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59486"}
[junit4:junit4] 2> 249555 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 249555 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 249555 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 249624 T797 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57278_
[junit4:junit4] 2> 249626 T797 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57278_
[junit4:junit4] 2> 249628 T839 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 249628 T826 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 249628 T819 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 249629 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 249628 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 249629 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 249643 T840 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369758158037/collection1
[junit4:junit4] 2> 249643 T840 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 249644 T840 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 249644 T840 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 249646 T840 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369758158037/collection1/'
[junit4:junit4] 2> 249647 T840 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369758158037/collection1/lib/README' to classloader
[junit4:junit4] 2> 249648 T840 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369758158037/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 249702 T840 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 249763 T840 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 249765 T840 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 249772 T840 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 250370 T840 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 250374 T840 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 250377 T840 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 250382 T840 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 250407 T840 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 250408 T840 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369758158037/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty1/
[junit4:junit4] 2> 250408 T840 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@430828fa
[junit4:junit4] 2> 250409 T840 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 250409 T840 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty1
[junit4:junit4] 2> 250410 T840 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty1/index/
[junit4:junit4] 2> 250410 T840 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 250411 T840 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty1/index
[junit4:junit4] 2> 250415 T840 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@303b7d3f lockFactory=org.apache.lucene.store.NativeFSLockFactory@270e5285),segFN=segments_1,generation=1}
[junit4:junit4] 2> 250415 T840 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 250418 T840 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 250419 T840 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 250420 T840 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 250420 T840 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 250421 T840 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 250421 T840 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 250422 T840 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 250422 T840 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 250423 T840 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 250439 T840 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 250446 T840 oass.SolrIndexSearcher.<init> Opening Searcher@3e676520 main
[junit4:junit4] 2> 250447 T840 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty1/tlog
[junit4:junit4] 2> 250448 T840 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 250448 T840 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 250453 T841 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e676520 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 250456 T840 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 250456 T840 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 251059 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 251060 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:57278_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57278"}
[junit4:junit4] 2> 251060 T820 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 251061 T820 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 251090 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 251090 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 251090 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 251460 T840 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 251460 T840 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57278 collection:collection1 shard:shard1
[junit4:junit4] 2> 251461 T840 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 251478 T840 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 251486 T840 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 251486 T840 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 251487 T840 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57278/collection1/
[junit4:junit4] 2> 251487 T840 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 251488 T840 oasc.SyncStrategy.syncToMe http://127.0.0.1:57278/collection1/ has no replicas
[junit4:junit4] 2> 251488 T840 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57278/collection1/
[junit4:junit4] 2> 251488 T840 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 252603 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 252622 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 252622 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 252622 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 252675 T840 oasc.ZkController.register We are http://127.0.0.1:57278/collection1/ and leader is http://127.0.0.1:57278/collection1/
[junit4:junit4] 2> 252675 T840 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57278
[junit4:junit4] 2> 252675 T840 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 252675 T840 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 252676 T840 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 252677 T840 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 252678 T797 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 252679 T797 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 252679 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 252939 T797 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 252943 T797 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:46416
[junit4:junit4] 2> 252944 T797 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 252944 T797 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 252945 T797 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369758162611
[junit4:junit4] 2> 252945 T797 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369758162611/solr.xml
[junit4:junit4] 2> 252946 T797 oasc.CoreContainer.<init> New CoreContainer 377656942
[junit4:junit4] 2> 252946 T797 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369758162611/'
[junit4:junit4] 2> 252947 T797 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369758162611/'
[junit4:junit4] 2> 253081 T797 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 253082 T797 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 253083 T797 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 253083 T797 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 253084 T797 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 253084 T797 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 253085 T797 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 253085 T797 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 253086 T797 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 253086 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 253103 T797 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 253104 T797 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43153/solr
[junit4:junit4] 2> 253105 T797 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 253106 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 253109 T853 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@297c62ef name:ZooKeeperConnection Watcher:127.0.0.1:43153 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 253110 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 253124 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 253133 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 253135 T855 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c0b969d name:ZooKeeperConnection Watcher:127.0.0.1:43153/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 253135 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 253147 T797 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 254133 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 254134 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:57278__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:57278_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57278"}
[junit4:junit4] 2> 254171 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 254171 T797 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46416_
[junit4:junit4] 2> 254171 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 254171 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 254171 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 254203 T797 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46416_
[junit4:junit4] 2> 254205 T819 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 254206 T855 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 254205 T839 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 254206 T826 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 254206 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 254206 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 254206 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 254206 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 254213 T856 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369758162611/collection1
[junit4:junit4] 2> 254213 T856 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 254214 T856 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 254214 T856 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 254215 T856 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369758162611/collection1/'
[junit4:junit4] 2> 254217 T856 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369758162611/collection1/lib/README' to classloader
[junit4:junit4] 2> 254217 T856 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369758162611/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 254270 T856 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 254335 T856 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 254336 T856 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 254344 T856 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 254941 T856 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 254945 T856 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 254947 T856 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 254953 T856 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 254979 T856 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 254980 T856 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369758162611/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty2/
[junit4:junit4] 2> 254980 T856 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@430828fa
[junit4:junit4] 2> 254981 T856 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 254982 T856 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty2
[junit4:junit4] 2> 254982 T856 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty2/index/
[junit4:junit4] 2> 254982 T856 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 254983 T856 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty2/index
[junit4:junit4] 2> 254986 T856 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6922dcac lockFactory=org.apache.lucene.store.NativeFSLockFactory@1935a11e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 254987 T856 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 254990 T856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 254990 T856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 254991 T856 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 254991 T856 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 254992 T856 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 254992 T856 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 254992 T856 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 254993 T856 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 254994 T856 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 255010 T856 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 255017 T856 oass.SolrIndexSearcher.<init> Opening Searcher@3ecc8122 main
[junit4:junit4] 2> 255017 T856 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty2/tlog
[junit4:junit4] 2> 255019 T856 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 255019 T856 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 255023 T857 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ecc8122 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 255025 T856 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 255025 T856 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 255705 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 255706 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46416_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46416"}
[junit4:junit4] 2> 255706 T820 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 255707 T820 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 255724 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 255724 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 255724 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 255724 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 256028 T856 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 256028 T856 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46416 collection:collection1 shard:shard2
[junit4:junit4] 2> 256029 T856 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 256045 T856 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 256056 T856 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 256056 T856 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 256056 T856 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:46416/collection1/
[junit4:junit4] 2> 256057 T856 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 256057 T856 oasc.SyncStrategy.syncToMe http://127.0.0.1:46416/collection1/ has no replicas
[junit4:junit4] 2> 256057 T856 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:46416/collection1/
[junit4:junit4] 2> 256057 T856 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 257229 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 257249 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 257249 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 257249 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 257249 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 257302 T856 oasc.ZkController.register We are http://127.0.0.1:46416/collection1/ and leader is http://127.0.0.1:46416/collection1/
[junit4:junit4] 2> 257302 T856 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46416
[junit4:junit4] 2> 257302 T856 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 257302 T856 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 257303 T856 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 257304 T856 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 257305 T797 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 257306 T797 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 257306 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 257578 T797 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 257582 T797 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:39601
[junit4:junit4] 2> 257583 T797 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 257584 T797 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 257584 T797 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369758167237
[junit4:junit4] 2> 257585 T797 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369758167237/solr.xml
[junit4:junit4] 2> 257585 T797 oasc.CoreContainer.<init> New CoreContainer 662475916
[junit4:junit4] 2> 257586 T797 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369758167237/'
[junit4:junit4] 2> 257586 T797 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369758167237/'
[junit4:junit4] 2> 257727 T797 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 257728 T797 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 257729 T797 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 257729 T797 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 257730 T797 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 257730 T797 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 257731 T797 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 257731 T797 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 257732 T797 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 257732 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 257749 T797 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 257750 T797 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43153/solr
[junit4:junit4] 2> 257751 T797 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 257752 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 257755 T869 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ff44f15 name:ZooKeeperConnection Watcher:127.0.0.1:43153 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 257756 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 257770 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 257782 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 257785 T871 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5eefc3c0 name:ZooKeeperConnection Watcher:127.0.0.1:43153/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 257785 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 257789 T797 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 258762 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 258763 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:46416__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46416_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46416"}
[junit4:junit4] 2> 258778 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 258778 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 258778 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 258778 T871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 258778 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 258793 T797 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39601_
[junit4:junit4] 2> 258795 T797 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39601_
[junit4:junit4] 2> 258797 T871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 258797 T819 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 258797 T839 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 258797 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 258797 T826 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 258797 T855 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 258798 T871 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 258798 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 258798 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 258798 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 258805 T872 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369758167237/collection1
[junit4:junit4] 2> 258805 T872 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 258806 T872 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 258806 T872 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 258807 T872 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369758167237/collection1/'
[junit4:junit4] 2> 258809 T872 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369758167237/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 258809 T872 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369758167237/collection1/lib/README' to classloader
[junit4:junit4] 2> 258860 T872 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 258934 T872 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 258936 T872 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 258943 T872 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 259494 T872 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 259497 T872 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 259499 T872 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 259503 T872 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 259535 T872 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 259535 T872 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369758167237/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3/
[junit4:junit4] 2> 259535 T872 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@430828fa
[junit4:junit4] 2> 259536 T872 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 259537 T872 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3
[junit4:junit4] 2> 259537 T872 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3/index/
[junit4:junit4] 2> 259537 T872 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 259538 T872 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3/index
[junit4:junit4] 2> 259540 T872 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9a4c2f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@21339312),segFN=segments_1,generation=1}
[junit4:junit4] 2> 259541 T872 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 259543 T872 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 259543 T872 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 259544 T872 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 259544 T872 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 259545 T872 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 259545 T872 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 259545 T872 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 259546 T872 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 259546 T872 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 259557 T872 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 259563 T872 oass.SolrIndexSearcher.<init> Opening Searcher@4ff9b491 main
[junit4:junit4] 2> 259563 T872 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3/tlog
[junit4:junit4] 2> 259564 T872 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 259564 T872 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 259568 T873 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4ff9b491 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 259570 T872 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 259570 T872 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 260282 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 260283 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:39601_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39601"}
[junit4:junit4] 2> 260283 T820 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 260283 T820 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 260321 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 260321 T871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 260321 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 260321 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 260321 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 260590 T872 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 260590 T872 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39601 collection:collection1 shard:shard1
[junit4:junit4] 2> 260594 T872 oasc.ZkController.register We are http://127.0.0.1:39601/collection1/ and leader is http://127.0.0.1:57278/collection1/
[junit4:junit4] 2> 260594 T872 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39601
[junit4:junit4] 2> 260594 T872 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 260595 T872 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C191 name=collection1 org.apache.solr.core.SolrCore@4347a150 url=http://127.0.0.1:39601/collection1 node=127.0.0.1:39601_ C191_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:39601_, base_url=http://127.0.0.1:39601}
[junit4:junit4] 2> 260601 T874 C191 P39601 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 260601 T872 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 260602 T874 C191 P39601 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 260602 T874 C191 P39601 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 260603 T874 C191 P39601 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 260603 T797 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 260603 T797 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 260604 T874 C191 P39601 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 260604 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 260632 T829 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:39601__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 260842 T797 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 260845 T797 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:26927
[junit4:junit4] 2> 260845 T797 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 260846 T797 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 260846 T797 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369758170539
[junit4:junit4] 2> 260847 T797 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369758170539/solr.xml
[junit4:junit4] 2> 260847 T797 oasc.CoreContainer.<init> New CoreContainer 202750909
[junit4:junit4] 2> 260848 T797 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369758170539/'
[junit4:junit4] 2> 260848 T797 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369758170539/'
[junit4:junit4] 2> 260952 T797 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 260953 T797 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 260953 T797 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 260953 T797 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 260954 T797 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 260954 T797 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 260955 T797 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 260955 T797 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 260955 T797 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 260956 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 260970 T797 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 260970 T797 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43153/solr
[junit4:junit4] 2> 260971 T797 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 260972 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 260974 T886 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@952cf6e name:ZooKeeperConnection Watcher:127.0.0.1:43153 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 260975 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 260991 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 260999 T797 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 261001 T888 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@195bd211 name:ZooKeeperConnection Watcher:127.0.0.1:43153/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 261002 T797 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 261011 T797 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 261825 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 261826 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:39601__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:39601_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39601"}
[junit4:junit4] 2> 261840 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 261840 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 261840 T888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 261840 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 261840 T871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 261840 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 262014 T797 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:26927_
[junit4:junit4] 2> 262016 T797 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:26927_
[junit4:junit4] 2> 262018 T871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 262018 T888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 262019 T826 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 262019 T855 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 262019 T839 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 262019 T819 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 262020 T871 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 262020 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 262020 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 262019 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 262020 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 262030 T888 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 262037 T889 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369758170539/collection1
[junit4:junit4] 2> 262037 T889 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 262038 T889 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 262038 T889 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 262040 T889 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369758170539/collection1/'
[junit4:junit4] 2> 262041 T889 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369758170539/collection1/lib/README' to classloader
[junit4:junit4] 2> 262042 T889 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369758170539/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 262098 T889 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 262158 T889 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 262160 T889 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 262167 T889 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 262635 T829 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:39601__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 262635 T829 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:39601__collection1&state=recovering&nodeName=127.0.0.1:39601_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 262745 T889 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 262749 T889 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 262752 T889 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 262757 T889 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 262780 T889 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 262781 T889 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369758170539/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4/
[junit4:junit4] 2> 262781 T889 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@430828fa
[junit4:junit4] 2> 262782 T889 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 262782 T889 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4
[junit4:junit4] 2> 262783 T889 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4/index/
[junit4:junit4] 2> 262783 T889 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 262783 T889 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4/index
[junit4:junit4] 2> 262787 T889 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b7525f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2091bf31),segFN=segments_1,generation=1}
[junit4:junit4] 2> 262788 T889 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 262791 T889 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 262791 T889 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 262792 T889 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 262793 T889 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 262793 T889 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 262793 T889 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 262794 T889 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 262794 T889 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 262795 T889 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 262811 T889 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 262818 T889 oass.SolrIndexSearcher.<init> Opening Searcher@7fedf60e main
[junit4:junit4] 2> 262819 T889 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4/tlog
[junit4:junit4] 2> 262820 T889 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 262820 T889 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 262825 T890 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7fedf60e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 262827 T889 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 262827 T889 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 263345 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 263346 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:26927_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:26927"}
[junit4:junit4] 2> 263346 T820 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 263346 T820 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 263361 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 263361 T871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 263361 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 263361 T888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 263361 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 263361 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 263831 T889 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 263831 T889 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:26927 collection:collection1 shard:shard2
[junit4:junit4] 2> 263834 T889 oasc.ZkController.register We are http://127.0.0.1:26927/collection1/ and leader is http://127.0.0.1:46416/collection1/
[junit4:junit4] 2> 263835 T889 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:26927
[junit4:junit4] 2> 263835 T889 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 263835 T889 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C192 name=collection1 org.apache.solr.core.SolrCore@736824fb url=http://127.0.0.1:26927/collection1 node=127.0.0.1:26927_ C192_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:26927_, base_url=http://127.0.0.1:26927}
[junit4:junit4] 2> 263836 T891 C192 P26927 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 263837 T889 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 263837 T891 C192 P26927 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 263838 T891 C192 P26927 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 263838 T891 C192 P26927 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 263838 T797 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 263839 T797 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 263839 T891 C192 P26927 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 263840 T797 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 263860 T797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 263862 T845 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:26927__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 263862 T797 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 263863 T797 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 263864 T797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C193 name=collection1 org.apache.solr.core.SolrCore@4347a150 url=http://127.0.0.1:39601/collection1 node=127.0.0.1:39601_ C193_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:39601_, base_url=http://127.0.0.1:39601}
[junit4:junit4] 2> 264638 T874 C193 P39601 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:57278/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 264638 T874 C193 P39601 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:39601 START replicas=[http://127.0.0.1:57278/collection1/] nUpdates=100
[junit4:junit4] 2> 264639 T874 C193 P39601 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 264640 T874 C193 P39601 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 264640 T874 C193 P39601 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 264640 T874 C193 P39601 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 264640 T874 C193 P39601 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 264641 T874 C193 P39601 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:57278/collection1/. core=collection1
[junit4:junit4] 2> 264641 T874 C193 P39601 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C194 name=collection1 org.apache.solr.core.SolrCore@286b0b2a url=http://127.0.0.1:57278/collection1 node=127.0.0.1:57278_ C194_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:57278_, base_url=http://127.0.0.1:57278, leader=true}
[junit4:junit4] 2> 264649 T830 C194 P57278 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 264660 T831 C194 P57278 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 264714 T831 C194 P57278 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@303b7d3f lockFactory=org.apache.lucene.store.NativeFSLockFactory@270e5285),segFN=segments_1,generation=1}
[junit4:junit4] 2> 264715 T831 C194 P57278 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 264716 T831 C194 P57278 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@303b7d3f lockFactory=org.apache.lucene.store.NativeFSLockFactory@270e5285),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@303b7d3f lockFactory=org.apache.lucene.store.NativeFSLockFactory@270e5285),segFN=segments_2,generation=2}
[junit4:junit4] 2> 264716 T831 C194 P57278 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 264717 T831 C194 P57278 oass.SolrIndexSearcher.<init> Opening Searcher@2c4cb39 realtime
[junit4:junit4] 2> 264717 T831 C194 P57278 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 264718 T831 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 63
[junit4:junit4] 2> 264719 T874 C193 P39601 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 264720 T874 C193 P39601 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 264745 T874 C193 P39601 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 264749 T832 C194 P57278 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 264750 T832 C194 P57278 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 264751 T874 C193 P39601 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 264751 T874 C193 P39601 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 264751 T874 C193 P39601 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 264755 T832 C194 P57278 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 264756 T874 C193 P39601 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 264757 T874 C193 P39601 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3/index.20130528172254672
[junit4:junit4] 2> 264758 T874 C193 P39601 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@853504f lockFactory=org.apache.lucene.store.NativeFSLockFactory@1757958d) fullCopy=false
[junit4:junit4] 2> 264761 T832 C194 P57278 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 264773 T874 C193 P39601 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 264776 T874 C193 P39601 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 264776 T874 C193 P39601 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 264786 T874 C193 P39601 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9a4c2f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@21339312),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9a4c2f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@21339312),segFN=segments_2,generation=2}
[junit4:junit4] 2> 264787 T874 C193 P39601 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 264787 T874 C193 P39601 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 264788 T874 C193 P39601 oass.SolrIndexSearcher.<init> Opening Searcher@2574d4bc main
[junit4:junit4] 2> 264789 T873 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2574d4bc main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 264789 T874 C193 P39601 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3/index.20130528172254672 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3/index.20130528172254672;done=true>>]
[junit4:junit4] 2> 264790 T874 C193 P39601 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3/index.20130528172254672
[junit4:junit4] 2> 264790 T874 C193 P39601 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty3/index.20130528172254672
[junit4:junit4] 2> 264790 T874 C193 P39601 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 264790 T874 C193 P39601 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 264791 T874 C193 P39601 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 264791 T874 C193 P39601 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 264819 T874 C193 P39601 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 264865 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 264866 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:26927__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:26927_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:26927"}
[junit4:junit4] 2> 264866 T797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 264869 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:39601__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:39601_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:39601"}
[junit4:junit4] 2> 264883 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264883 T888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264883 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264883 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264883 T871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 264883 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 265865 T845 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:26927__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 265865 T845 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:26927__collection1&state=recovering&nodeName=127.0.0.1:26927_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 265868 T797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 266870 T797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C192_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:26927_, base_url=http://127.0.0.1:26927}
[junit4:junit4] 2> 267868 T891 C192 P26927 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:46416/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 267868 T891 C192 P26927 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:26927 START replicas=[http://127.0.0.1:46416/collection1/] nUpdates=100
[junit4:junit4] 2> 267869 T891 C192 P26927 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 267870 T891 C192 P26927 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 267870 T891 C192 P26927 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 267870 T891 C192 P26927 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 267870 T891 C192 P26927 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 267871 T891 C192 P26927 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:46416/collection1/. core=collection1
[junit4:junit4] 2> 267871 T891 C192 P26927 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 267873 T797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C195 name=collection1 org.apache.solr.core.SolrCore@e829fbd url=http://127.0.0.1:46416/collection1 node=127.0.0.1:46416_ C195_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46416_, base_url=http://127.0.0.1:46416, leader=true}
[junit4:junit4] 2> 267881 T846 C195 P46416 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 267887 T847 C195 P46416 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 267940 T847 C195 P46416 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6922dcac lockFactory=org.apache.lucene.store.NativeFSLockFactory@1935a11e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 267941 T847 C195 P46416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 267941 T847 C195 P46416 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6922dcac lockFactory=org.apache.lucene.store.NativeFSLockFactory@1935a11e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6922dcac lockFactory=org.apache.lucene.store.NativeFSLockFactory@1935a11e),segFN=segments_2,generation=2}
[junit4:junit4] 2> 267942 T847 C195 P46416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 267943 T847 C195 P46416 oass.SolrIndexSearcher.<init> Opening Searcher@4c766227 realtime
[junit4:junit4] 2> 267943 T847 C195 P46416 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 267943 T847 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 57
[junit4:junit4] 2> 267945 T891 C192 P26927 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 267945 T891 C192 P26927 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 267949 T848 C195 P46416 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 267949 T848 C195 P46416 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 267950 T891 C192 P26927 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 267950 T891 C192 P26927 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 267951 T891 C192 P26927 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 267954 T848 C195 P46416 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 267955 T891 C192 P26927 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 267956 T891 C192 P26927 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4/index.20130528172257871
[junit4:junit4] 2> 267956 T891 C192 P26927 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@70441c24 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5f343899) fullCopy=false
[junit4:junit4] 2> 267959 T848 C195 P46416 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 267961 T891 C192 P26927 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 267962 T891 C192 P26927 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 267963 T891 C192 P26927 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 267965 T891 C192 P26927 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b7525f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2091bf31),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b7525f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2091bf31),segFN=segments_2,generation=2}
[junit4:junit4] 2> 267965 T891 C192 P26927 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 267965 T891 C192 P26927 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 267966 T891 C192 P26927 oass.SolrIndexSearcher.<init> Opening Searcher@4c2e3a5d main
[junit4:junit4] 2> 267967 T890 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c2e3a5d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 267968 T891 C192 P26927 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4/index.20130528172257871 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4/index.20130528172257871;done=true>>]
[junit4:junit4] 2> 267968 T891 C192 P26927 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4/index.20130528172257871
[junit4:junit4] 2> 267968 T891 C192 P26927 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369758154218/jetty4/index.20130528172257871
[junit4:junit4] 2> 267968 T891 C192 P26927 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 267969 T891 C192 P26927 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 267969 T891 C192 P26927 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 267969 T891 C192 P26927 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 267971 T891 C192 P26927 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 268876 T797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 269403 T820 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 269404 T820 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:26927__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:26927_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:26927"}
[junit4:junit4] 2> 269418 T819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269419 T888 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269418 T855 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269418 T839 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269418 T826 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269418 T871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269878 T797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 269879 T797 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C196 name=collection1 org.apache.solr.core.SolrCore@2231d092 url=http://127.0.0.1:59486/collection1 node=127.0.0.1:59486_ C196_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:59486_, base_url=http://127.0.0.1:59486, leader=true}
[junit4:junit4] 2> 269890 T809 C196 P59486 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 269944 T809 C196 P59486 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5700078 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3624d38a),segFN=segments_1,generation=1}
[junit4:junit4] 2> 269945 T809 C196 P59486 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 269946 T809 C196 P59486 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5700078 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3624d38a),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5700078 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3624d38a),segFN=segments_2,generation=2}
[junit4:junit4] 2> 269947 T809 C196 P59486 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 269947 T809 C196 P59486 oass.SolrIndexSearcher.<init> Opening Searcher@40059ee9 main
[junit4:junit4] 2> 269948 T809 C196 P59486 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 269949 T823 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40059ee9 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 269950 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 61
[junit4:junit4] 2> 269963 T833 C194 P57278 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 269964 T833 C194 P57278 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@303b7d3f lockFactory=org.apache.lucene.store.NativeFSLockFactory@270e5285),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@303b7d3f lockFactory=org.apache.lucene.store.NativeFSLockFactory@270e5285),segFN=segments_3,generation=3}
[junit4:junit4] 2> 269965 T833 C194 P57278 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 269966 T833 C194 P57278 oass.SolrIndexSearcher.<init> Opening Searcher@33442677 main
[junit4:junit4] 2> 269966 T833 C194 P57278 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 269967 T841 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33442677 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 269986 T833 C194 P57278 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:39601/collection1/, StdNode: http://127.0.0.1:46416/collection1/, StdNode: http://127.0.0.1:26927/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 269997 T849 C195 P46416 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 269999 T849 C195 P46416 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6922dcac lockFactory=org.apache.lucene.store.NativeFSLockFactory@1935a11e),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6922dcac lockFactory=org.apache.lucene.store.NativeFSLockFactory@1935a11e),segFN=segments_3,generation=3}
[junit4:junit4] 2> 269999 T849 C195 P46416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 270000 T849 C195 P46416 oass.SolrIndexSearcher.<init> Opening Searcher@4fd22fec main
[junit4:junit4] 2> 270000 T849 C195 P46416 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 270001 T857 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4fd22fec main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 270002 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C193_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:39601_, base_url=http://127.0.0.1:39601}
[junit4:junit4] 2> 270005 T861 C193 P39601 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C192_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:26927_, base_url=http://127.0.0.1:26927}
[junit4:junit4] 2> 270005 T878 C192 P26927 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 270006 T861 C193 P39601 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9a4c2f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@21339312),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9a4c2f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@21339312),segFN=segments_3,generation=3}
[junit4:junit4] 2> 270007 T878 C192 P26927 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b7525f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2091bf31),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@44b7525f lockFactory=org.apache.lucene.store.NativeFSLockFactory@2091bf31),segFN=segments_3,generation=3}
[junit4:junit4] 2> 270007 T861 C193 P39601 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 270008 T878 C192 P26927 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 270009 T861 C193 P39601 oass.SolrIndexSearcher.<init> Opening Searcher@60c630e2 main
[junit4:junit4] 2> 270009 T878 C192 P26927 oass.SolrIndexSearcher.<init> Opening Searcher@68674158 main
[junit4:junit4] 2> 270010 T861 C193 P39601 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 270010 T878 C192 P26927 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 270011 T873 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60c630e2 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 270011 T890 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@68674158 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 270011 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 270012 T878 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 270013 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 50
[junit4:junit4] 2> 270014 T797 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 270018 T834 C194 P57278 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 270021 T862 C193 P39601 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 270025 T850 C195 P46416 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 270028 T879 C192 P26927 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 272043 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436295555403743232)} 0 9
[junit4:junit4] 2> 272061 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1436295555410034688&update.from=http://127.0.0.1:46416/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436295555410034688)} 0 2
[junit4:junit4] 2> 272066 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1436295555422617600&update.from=http://127.0.0.1:57278/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436295555422617600)} 0 2
[junit4:junit4] 2> 272067 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1436295555422617600)} 0 8
[junit4:junit4] 2> 272068 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436295555410034688)} 0 21
[junit4:junit4] 2> 272073 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1436295555436249088)]} 0 2
[junit4:junit4] 2> 272106 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1436295555465609216)]} 0 1
[junit4:junit4] 2> 272107 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1436295555465609216)]} 0 8
[junit4:junit4] 2> 272108 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0]} 0 32
[junit4:junit4] 2> 272113 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1436295555479240704)]} 0 1
[junit4:junit4] 2> 272122 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1436295555483435008)]} 0 2
[junit4:junit4] 2> 272122 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1436295555483435008)]} 0 6
[junit4:junit4] 2> 272126 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1436295555491823616)]} 0 1
[junit4:junit4] 2> 272133 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1436295555496017920)]} 0 1
[junit4:junit4] 2> 272134 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1436295555496017920)]} 0 5
[junit4:junit4] 2> 272138 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1436295555505455104)]} 0 1
[junit4:junit4] 2> 272148 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1436295555512795136)]} 0 1
[junit4:junit4] 2> 272149 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!3 (1436295555512795136)]} 0 5
[junit4:junit4] 2> 272150 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3]} 0 10
[junit4:junit4] 2> 272154 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1436295555522232320)]} 0 1
[junit4:junit4] 2> 272162 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1436295555526426624)]} 0 1
[junit4:junit4] 2> 272163 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1436295555526426624)]} 0 6
[junit4:junit4] 2> 272168 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1436295555536912384)]} 0 1
[junit4:junit4] 2> 272175 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1436295555541106688)]} 0 1
[junit4:junit4] 2> 272176 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1436295555541106688)]} 0 5
[junit4:junit4] 2> 272180 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1436295555549495296)]} 0 1
[junit4:junit4] 2> 272188 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1436295555553689600)]} 0 1
[junit4:junit4] 2> 272189 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1436295555553689600)]} 0 5
[junit4:junit4] 2> 272194 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1436295555564175360)]} 0 1
[junit4:junit4] 2> 272201 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1436295555568369664)]} 0 1
[junit4:junit4] 2> 272202 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1436295555568369664)]} 0 5
[junit4:junit4] 2> 272206 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1436295555576758272)]} 0 1
[junit4:junit4] 2> 272213 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1436295555580952576)]} 0 1
[junit4:junit4] 2> 272214 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1436295555580952576)]} 0 5
[junit4:junit4] 2> 272218 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1436295555589341184)]} 0 1
[junit4:junit4] 2> 272230 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1436295555597729792)]} 0 1
[junit4:junit4] 2> 272231 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!9 (1436295555597729792)]} 0 6
[junit4:junit4] 2> 272232 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9]} 0 11
[junit4:junit4] 2> 272237 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1436295555609264128)]} 0 1
[junit4:junit4] 2> 272244 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1436295555613458432)]} 0 1
[junit4:junit4] 2> 272245 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1436295555613458432)]} 0 5
[junit4:junit4] 2> 272249 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1436295555621847040)]} 0 1
[junit4:junit4] 2> 272260 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1436295555630235648)]} 0 1
[junit4:junit4] 2> 272261 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1436295555630235648)]} 0 5
[junit4:junit4] 2> 272262 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11]} 0 10
[junit4:junit4] 2> 272266 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1436295555638624256)]} 0 1
[junit4:junit4] 2> 272273 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1436295555643867136)]} 0 1
[junit4:junit4] 2> 272274 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1436295555643867136)]} 0 5
[junit4:junit4] 2> 272278 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1436295555652255744)]} 0 1
[junit4:junit4] 2> 272285 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1436295555656450048)]} 0 1
[junit4:junit4] 2> 272286 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1436295555656450048)]} 0 5
[junit4:junit4] 2> 272290 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1436295555663790080)]} 0 1
[junit4:junit4] 2> 272298 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1436295555667984384)]} 0 1
[junit4:junit4] 2> 272299 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1436295555667984384)]} 0 6
[junit4:junit4] 2> 272303 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1436295555678470144)]} 0 1
[junit4:junit4] 2> 272310 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1436295555681615872)]} 0 1
[junit4:junit4] 2> 272311 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1436295555681615872)]} 0 5
[junit4:junit4] 2> 272315 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1436295555690004480)]} 0 1
[junit4:junit4] 2> 272326 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1436295555698393088)]} 0 1
[junit4:junit4] 2> 272327 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1436295555698393088)]} 0 6
[junit4:junit4] 2> 272328 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16]} 0 10
[junit4:junit4] 2> 272331 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1436295555706781696)]} 0 1
[junit4:junit4] 2> 272339 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1436295555712024576)]} 0 1
[junit4:junit4] 2> 272340 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1436295555712024576)]} 0 6
[junit4:junit4] 2> 272344 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1436295555720413184)]} 0 1
[junit4:junit4] 2> 272354 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1436295555728801792)]} 0 1
[junit4:junit4] 2> 272355 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1436295555728801792)]} 0 5
[junit4:junit4] 2> 272356 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18]} 0 9
[junit4:junit4] 2> 272360 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1436295555737190400)]} 0 1
[junit4:junit4] 2> 272371 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1436295555746627584)]} 0 1
[junit4:junit4] 2> 272372 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!19 (1436295555746627584)]} 0 5
[junit4:junit4] 2> 272373 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19]} 0 10
[junit4:junit4] 2> 272377 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1436295555756064768)]} 0 1
[junit4:junit4] 2> 272387 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1436295555763404800)]} 0 1
[junit4:junit4] 2> 272388 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1436295555763404800)]} 0 5
[junit4:junit4] 2> 272389 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 9
[junit4:junit4] 2> 272393 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1436295555772841984)]} 0 1
[junit4:junit4] 2> 272400 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1436295555777036288)]} 0 1
[junit4:junit4] 2> 272401 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1436295555777036288)]} 0 5
[junit4:junit4] 2> 272405 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1436295555785424896)]} 0 1
[junit4:junit4] 2> 272412 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1436295555789619200)]} 0 1
[junit4:junit4] 2> 272413 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1436295555789619200)]} 0 5
[junit4:junit4] 2> 272417 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1436295555798007808)]} 0 1
[junit4:junit4] 2> 272427 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1436295555805347840)]} 0 1
[junit4:junit4] 2> 272428 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1436295555805347840)]} 0 5
[junit4:junit4] 2> 272429 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23]} 0 9
[junit4:junit4] 2> 272433 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1436295555814785024)]} 0 1
[junit4:junit4] 2> 272444 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1436295555822125056)]} 0 1
[junit4:junit4] 2> 272445 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1436295555822125056)]} 0 6
[junit4:junit4] 2> 272446 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24]} 0 10
[junit4:junit4] 2> 272450 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1436295555831562240)]} 0 1
[junit4:junit4] 2> 272458 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1436295555835756544)]} 0 1
[junit4:junit4] 2> 272459 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1436295555835756544)]} 0 6
[junit4:junit4] 2> 272463 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1436295555845193728)]} 0 1
[junit4:junit4] 2> 272476 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1436295555854630912)]} 0 1
[junit4:junit4] 2> 272477 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!26 (1436295555854630912)]} 0 6
[junit4:junit4] 2> 272478 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26]} 0 12
[junit4:junit4] 2> 272482 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1436295555866165248)]} 0 1
[junit4:junit4] 2> 272493 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1436295555874553856)]} 0 1
[junit4:junit4] 2> 272494 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1436295555874553856)]} 0 5
[junit4:junit4] 2> 272495 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 10
[junit4:junit4] 2> 272499 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1436295555882942464)]} 0 1
[junit4:junit4] 2> 272509 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1436295555891331072)]} 0 1
[junit4:junit4] 2> 272510 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1436295555891331072)]} 0 5
[junit4:junit4] 2> 272511 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 9
[junit4:junit4] 2> 272515 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1436295555900768256)]} 0 1
[junit4:junit4] 2> 272525 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1436295555908108288)]} 0 1
[junit4:junit4] 2> 272526 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1436295555908108288)]} 0 5
[junit4:junit4] 2> 272527 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29]} 0 9
[junit4:junit4] 2> 272531 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1436295555916496896)]} 0 1
[junit4:junit4] 2> 272539 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1436295555922788352)]} 0 1
[junit4:junit4] 2> 272540 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1436295555922788352)]} 0 5
[junit4:junit4] 2> 272545 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1436295555932225536)]} 0 1
[junit4:junit4] 2> 272553 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1436295555937468416)]} 0 1
[junit4:junit4] 2> 272554 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1436295555937468416)]} 0 5
[junit4:junit4] 2> 272558 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1436295555945857024)]} 0 1
[junit4:junit4] 2> 272568 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1436295555953197056)]} 0 1
[junit4:junit4] 2> 272569 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!32 (1436295555953197056)]} 0 5
[junit4:junit4] 2> 272570 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32]} 0 9
[junit4:junit4] 2> 272574 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1436295555962634240)]} 0 1
[junit4:junit4] 2> 272582 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1436295555967877120)]} 0 1
[junit4:junit4] 2> 272583 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1436295555967877120)]} 0 5
[junit4:junit4] 2> 272587 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1436295555975217152)]} 0 1
[junit4:junit4] 2> 272597 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1436295555983605760)]} 0 1
[junit4:junit4] 2> 272598 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1436295555983605760)]} 0 5
[junit4:junit4] 2> 272599 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34]} 0 9
[junit4:junit4] 2> 272603 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1436295555993042944)]} 0 1
[junit4:junit4] 2> 272610 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1436295555996188672)]} 0 1
[junit4:junit4] 2> 272611 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1436295555996188672)]} 0 5
[junit4:junit4] 2> 272615 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1436295556005625856)]} 0 1
[junit4:junit4] 2> 272623 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1436295556008771584)]} 0 1
[junit4:junit4] 2> 272624 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1436295556008771584)]} 0 6
[junit4:junit4] 2> 272628 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1436295556018208768)]} 0 1
[junit4:junit4] 2> 272639 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1436295556027645952)]} 0 1
[junit4:junit4] 2> 272640 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1436295556027645952)]} 0 5
[junit4:junit4] 2> 272641 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37]} 0 10
[junit4:junit4] 2> 272645 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1436295556037083136)]} 0 1
[junit4:junit4] 2> 272653 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1436295556041277440)]} 0 1
[junit4:junit4] 2> 272654 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1436295556041277440)]} 0 6
[junit4:junit4] 2> 272658 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1436295556049666048)]} 0 1
[junit4:junit4] 2> 272666 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1436295556053860352)]} 0 1
[junit4:junit4] 2> 272667 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1436295556053860352)]} 0 6
[junit4:junit4] 2> 272672 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1436295556065394688)]} 0 1
[junit4:junit4] 2> 272681 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1436295556070637568)]} 0 1
[junit4:junit4] 2> 272682 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1436295556070637568)]} 0 6
[junit4:junit4] 2> 272685 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1436295556077977600)]} 0 1
[junit4:junit4] 2> 272695 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1436295556086366208)]} 0 1
[junit4:junit4] 2> 272696 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!41 (1436295556086366208)]} 0 5
[junit4:junit4] 2> 272696 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41]} 0 8
[junit4:junit4] 2> 272701 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1436295556094754816)]} 0 1
[junit4:junit4] 2> 272711 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1436295556102094848)]} 0 1
[junit4:junit4] 2> 272712 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!42 (1436295556102094848)]} 0 5
[junit4:junit4] 2> 272713 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42]} 0 9
[junit4:junit4] 2> 272717 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1436295556112580608)]} 0 1
[junit4:junit4] 2> 272729 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1436295556122017792)]} 0 1
[junit4:junit4] 2> 272730 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!43 (1436295556122017792)]} 0 5
[junit4:junit4] 2> 272731 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43]} 0 10
[junit4:junit4] 2> 272735 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1436295556131454976)]} 0 1
[junit4:junit4] 2> 272747 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1436295556139843584)]} 0 1
[junit4:junit4] 2> 272748 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!44 (1436295556139843584)]} 0 6
[junit4:junit4] 2> 272749 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44]} 0 11
[junit4:junit4] 2> 272753 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1436295556150329344)]} 0 1
[junit4:junit4] 2> 272765 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1436295556158717952)]} 0 1
[junit4:junit4] 2> 272766 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!45 (1436295556158717952)]} 0 6
[junit4:junit4] 2> 272767 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45]} 0 11
[junit4:junit4] 2> 272771 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1436295556168155136)]} 0 1
[junit4:junit4] 2> 272781 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1436295556176543744)]} 0 1
[junit4:junit4] 2> 272782 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!46 (1436295556176543744)]} 0 5
[junit4:junit4] 2> 272782 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46]} 0 8
[junit4:junit4] 2> 272787 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1436295556184932352)]} 0 1
[junit4:junit4] 2> 272797 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1436295556193320960)]} 0 1
[junit4:junit4] 2> 272798 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1436295556193320960)]} 0 5
[junit4:junit4] 2> 272799 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 9
[junit4:junit4] 2> 272803 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1436295556202758144)]} 0 1
[junit4:junit4] 2> 272811 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1436295556206952448)]} 0 1
[junit4:junit4] 2> 272812 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1436295556206952448)]} 0 6
[junit4:junit4] 2> 272816 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1436295556215341056)]} 0 1
[junit4:junit4] 2> 272826 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1436295556223729664)]} 0 1
[junit4:junit4] 2> 272827 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1436295556223729664)]} 0 5
[junit4:junit4] 2> 272828 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49]} 0 9
[junit4:junit4] 2> 272832 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1436295556233166848)]} 0 1
[junit4:junit4] 2> 272840 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1436295556237361152)]} 0 1
[junit4:junit4] 2> 272841 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1436295556237361152)]} 0 5
[junit4:junit4] 2> 272845 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1436295556246798336)]} 0 1
[junit4:junit4] 2> 272856 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1436295556254138368)]} 0 1
[junit4:junit4] 2> 272857 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!51 (1436295556254138368)]} 0 6
[junit4:junit4] 2> 272858 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51]} 0 10
[junit4:junit4] 2> 272862 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1436295556263575552)]} 0 1
[junit4:junit4] 2> 272869 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1436295556268818432)]} 0 1
[junit4:junit4] 2> 272870 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1436295556268818432)]} 0 5
[junit4:junit4] 2> 272875 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1436295556278255616)]} 0 1
[junit4:junit4] 2> 272887 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1436295556286644224)]} 0 1
[junit4:junit4] 2> 272888 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1436295556286644224)]} 0 6
[junit4:junit4] 2> 272889 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53]} 0 10
[junit4:junit4] 2> 272893 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1436295556297129984)]} 0 1
[junit4:junit4] 2> 272902 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1436295556302372864)]} 0 1
[junit4:junit4] 2> 272903 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1436295556302372864)]} 0 6
[junit4:junit4] 2> 272908 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1436295556311810048)]} 0 1
[junit4:junit4] 2> 272920 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1436295556322295808)]} 0 1
[junit4:junit4] 2> 272921 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1436295556322295808)]} 0 5
[junit4:junit4] 2> 272922 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55]} 0 10
[junit4:junit4] 2> 272926 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1436295556331732992)]} 0 1
[junit4:junit4] 2> 272938 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1436295556340121600)]} 0 0
[junit4:junit4] 2> 272939 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1436295556340121600)]} 0 6
[junit4:junit4] 2> 272940 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 10
[junit4:junit4] 2> 272945 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1436295556351655936)]} 0 1
[junit4:junit4] 2> 272957 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1436295556360044544)]} 0 1
[junit4:junit4] 2> 272958 T849 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1436295556360044544)]} 0 6
[junit4:junit4] 2> 272959 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57]} 0 10
[junit4:junit4] 2> 272963 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1436295556370530304)]} 0 1
[junit4:junit4] 2> 272970 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1436295556374724608)]} 0 1
[junit4:junit4] 2> 272971 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1436295556374724608)]} 0 5
[junit4:junit4] 2> 272976 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1436295556384161792)]} 0 1
[junit4:junit4] 2> 272985 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1436295556389404672)]} 0 1
[junit4:junit4] 2> 272986 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1436295556389404672)]} 0 6
[junit4:junit4] 2> 272991 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1436295556399890432)]} 0 1
[junit4:junit4] 2> 273002 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1436295556408279040)]} 0 1
[junit4:junit4] 2> 273003 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1436295556408279040)]} 0 5
[junit4:junit4] 2> 273004 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60]} 0 9
[junit4:junit4] 2> 273008 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1436295556416667648)]} 0 1
[junit4:junit4] 2> 273020 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1436295556427153408)]} 0 1
[junit4:junit4] 2> 273021 T835 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!61 (1436295556427153408)]} 0 5
[junit4:junit4] 2> 273022 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61]} 0 10
[junit4:junit4] 2> 273027 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1436295556437639168)]} 0 1
[junit4:junit4] 2> 273035 T861 C193 P39601 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:57278/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1436295556441833472)]} 0 1
[junit4:junit4] 2> 273036 T833 C194 P57278 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1436295556441833472)]} 0 5
[junit4:junit4] 2> 273040 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1436295556450222080)]} 0 1
[junit4:junit4] 2> 273047 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1436295556454416384)]} 0 1
[junit4:junit4] 2> 273048 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1436295556454416384)]} 0 5
[junit4:junit4] 2> 273052 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1436295556462804992)]} 0 1
[junit4:junit4] 2> 273059 T880 C192 P26927 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46416/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1436295556466999296)]} 0 1
[junit4:junit4] 2> 273060 T851 C195 P46416 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1436295556466999296)]} 0 5
[junit4:junit4] 2> 273064 T809 C196 P59486 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin
[...truncated too long message...]
re@f713610
[junit4:junit4] 2> 1658367 T3763 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=615,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1658368 T3763 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1658369 T3763 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1658369 T3763 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1658371 T3763 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1658372 T3763 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1658372 T3763 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369759395004/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369759395004/jetty4/index;done=false>>]
[junit4:junit4] 2> 1658373 T3763 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369759395004/jetty4/index
[junit4:junit4] 2> 1658373 T3763 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369759395004/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369759395004/jetty4;done=false>>]
[junit4:junit4] 2> 1658374 T3763 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369759395004/jetty4
[junit4:junit4] 2> 1658375 T3918 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89768551711506444-127.0.0.1:23771_x_%2Fo-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 1658376 T3854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1658376 T3854 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1658377 T3763 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/x_/o,null}
[junit4:junit4] 2> 1658377 T3854 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1658447 T3763 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1658449 T3763 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:63295 63295
[junit4:junit4] 2> 1658604 T3837 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1659830 T3837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1659831 T3837 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1659833 T3763 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 63299
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369759395004 FAILED !!!!!
[junit4:junit4] 2> 1659834 T3763 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1659834 T3763 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:63295 63295
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeyShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=EB1CA6E4AFF51C08 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pt_PT -Dtests.timezone=Etc/GMT+11 -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 175s J1 | ChaosMonkeyShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:63308/x_/o returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([EB1CA6E4AFF51C08:6AFA28FCD8AA7C34]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1659854 T3763 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=pt_PT, timezone=Etc/GMT+11
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=1,free=195214880,total=521142272
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestPostingsSolrHighlighter, TestJmxIntegration, TestIndexSearcher, TestDistributedGrouping, TestAddFieldRealTimeGet, SolrTestCaseJ4Test, TestSolrQueryParserDefaultOperatorResource, TestSchemaNameResource, SolrCmdDistributorTest, CoreContainerCoreInitFailuresTest, DistanceFunctionTest, CollectionsAPIDistributedZkTest, TestMergePolicyConfig, TestOmitPositions, FieldAnalysisRequestHandlerTest, CurrencyFieldOpenExchangeTest, SpellPossibilityIteratorTest, TestFieldTypeResource, URLClassifyProcessorTest, ShardRoutingCustomTest, ClusterStateTest, TestIndexingPerformance, HighlighterConfigTest, TestBinaryResponseWriter, HardAutoCommitTest, CachingDirectoryFactoryTest, TestUtils, DocumentAnalysisRequestHandlerTest, SolrPluginUtilsTest, SolrIndexConfigTest, TestSolrJ, TestRandomFaceting, ChaosMonkeySafeLeaderTest, TestDefaultSearchFieldResource, TestElisionMultitermQuery, TestCSVResponseWriter, UniqFieldsUpdateProcessorFactoryTest, TestRecovery, SolrCoreCheckLockOnStartupTest, LeaderElectionIntegrationTest, IndexBasedSpellCheckerTest, TestSolrXml, ZkSolrClientTest, TestFoldingMultitermQuery, BadIndexSchemaTest, SimplePostToolTest, EchoParamsTest, CopyFieldTest, NoCacheHeaderTest, DisMaxRequestHandlerTest, NumericFieldsTest, TestSuggestSpellingConverter, TestLazyCores, TestReload, TestAtomicUpdateErrorCases, SpellCheckComponentTest, TestHashPartitioner, SuggesterWFSTTest, TestMultiCoreConfBootstrap, TestQuerySenderNoQuery, SuggesterTSTTest, TestStressLucene, TestSerializedLuceneMatchVersion, PathHierarchyTokenizerFactoryTest, TestBinaryField, TermVectorComponentDistributedTest, OpenCloseCoreStressTest, TestDistributedSearch, TestLuceneMatchVersion, TestSchemaSimilarityResource, BasicDistributedZk2Test, ShardRoutingTest, BasicZkTest, ClusterStateUpdateTest, TestZkChroot, ZkCLITest, SliceStateUpdateTest, AutoCommitTest, TestRealTimeGet, TestStressReorder, TestStressVersions, TestRangeQuery, TestSolr4Spatial, StatsComponentTest, TestGroupingSearch, ConvertedLegacyTest, TestFiltering, CurrencyFieldXmlFileTest, SuggesterFSTTest, TestTrie, TestCSVLoader, PolyFieldTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, DocValuesMultiTest, DebugComponentTest, TestSurroundQueryParser, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, PrimitiveFieldTypeTest, XmlUpdateRequestHandlerTest, DocumentBuilderTest, TermVectorComponentTest, TestArbitraryIndexDir, IndexSchemaTest, UpdateRequestProcessorFactoryTest, QueryParsingTest, JsonLoaderTest, TestPartialUpdateDeduplication, PingRequestHandlerTest, SearchHandlerTest, TestPropInject, UpdateParamsTest, MultiTermTest, TestDocSet, TestConfig, OutputWriterTest, ExternalFileFieldSortTest, TestCodecSupport, TestDFRSimilarityFactory, TestNumberUtils, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TimeZoneUtilsTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, TestSolrXMLSerializer, TestSystemIdResolver, DateFieldTest, DOMUtilTest, TestDocumentBuilder, SliceStateTest, FileUtilsTest, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J1 in 175.25s, 1 test, 1 error <<< FAILURES!
[...truncated 11 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:380: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:360: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1232 tests, 2 errors, 13 ignored (7 assumptions)
Total time: 48 minutes 37 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4022 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4022/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:62311/v_ returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:62311/v_ returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([F025ACC0313AC5E5:71C322D84665A5D9]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9264 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 182189 T739 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /v_/
[junit4:junit4] 2> 182197 T739 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1369718903799
[junit4:junit4] 2> 182209 T739 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 182219 T740 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 182420 T739 oasc.ZkTestServer.run start zk server on port:62017
[junit4:junit4] 2> 182727 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 182860 T746 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@260b1da1 name:ZooKeeperConnection Watcher:127.0.0.1:62017 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 182861 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 182867 T739 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 182987 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 182990 T748 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@159475c7 name:ZooKeeperConnection Watcher:127.0.0.1:62017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 182990 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 182991 T739 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 183002 T739 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 183007 T739 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 183013 T739 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 183019 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 183020 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 183034 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 183035 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 183141 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 183142 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 183153 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 183153 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 183158 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 183159 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 183164 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 183164 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 183169 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 183170 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 183175 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 183175 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 183180 T739 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 183181 T739 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 183414 T739 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 183417 T739 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:10730
[junit4:junit4] 2> 183418 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 183418 T739 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 183418 T739 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369718904788
[junit4:junit4] 2> 183419 T739 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369718904788/solr.xml
[junit4:junit4] 2> 183419 T739 oasc.CoreContainer.<init> New CoreContainer 297399861
[junit4:junit4] 2> 183420 T739 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369718904788/'
[junit4:junit4] 2> 183420 T739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369718904788/'
[junit4:junit4] 2> 183530 T739 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 183530 T739 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 183531 T739 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 183531 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 183532 T739 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 183532 T739 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 183532 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 183533 T739 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 183533 T739 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 183534 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 183547 T739 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 183548 T739 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62017/solr
[junit4:junit4] 2> 183565 T739 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 183566 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 183569 T759 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c458b57 name:ZooKeeperConnection Watcher:127.0.0.1:62017 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 183569 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 183577 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 183591 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 183593 T761 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7088d037 name:ZooKeeperConnection Watcher:127.0.0.1:62017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 183594 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 183606 T739 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 183622 T739 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 183642 T739 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 183645 T739 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:10730_v_
[junit4:junit4] 2> 183652 T739 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:10730_v_
[junit4:junit4] 2> 183657 T739 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 183695 T739 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 183699 T739 oasc.Overseer.start Overseer (id=89765898096869379-127.0.0.1:10730_v_-n_0000000000) starting
[junit4:junit4] 2> 183726 T739 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 183755 T763 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 183756 T739 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 183760 T739 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 183763 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 183792 T762 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 183807 T764 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369718904788/collection1
[junit4:junit4] 2> 183808 T764 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 183809 T764 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 183809 T764 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 183812 T764 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369718904788/collection1/'
[junit4:junit4] 2> 183813 T764 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369718904788/collection1/lib/README' to classloader
[junit4:junit4] 2> 183814 T764 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369718904788/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 183883 T764 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 183932 T764 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 184034 T764 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 184044 T764 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 184589 T764 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 184593 T764 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 184595 T764 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 184601 T764 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 184647 T764 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 184647 T764 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369718904788/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/control/data/
[junit4:junit4] 2> 184647 T764 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@50ed8317
[junit4:junit4] 2> 184648 T764 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 184649 T764 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/control/data
[junit4:junit4] 2> 184649 T764 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/control/data/index/
[junit4:junit4] 2> 184649 T764 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 184650 T764 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/control/data/index
[junit4:junit4] 2> 184654 T764 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42f4aaa lockFactory=org.apache.lucene.store.NativeFSLockFactory@74effb5c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 184655 T764 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 184657 T764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 184658 T764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 184659 T764 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 184659 T764 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 184660 T764 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 184660 T764 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 184660 T764 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 184661 T764 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 184661 T764 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 184677 T764 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 184684 T764 oass.SolrIndexSearcher.<init> Opening Searcher@1662954f main
[junit4:junit4] 2> 184684 T764 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/control/data/tlog
[junit4:junit4] 2> 184686 T764 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 184686 T764 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 184689 T765 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1662954f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 184691 T764 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 184691 T764 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 185304 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 185305 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:10730_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10730/v_"}
[junit4:junit4] 2> 185306 T762 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 185317 T762 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 185376 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 185697 T764 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 185697 T764 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:10730/v_ collection:control_collection shard:shard1
[junit4:junit4] 2> 185711 T764 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 185730 T764 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 185753 T764 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 185765 T764 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 185765 T764 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 185765 T764 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:10730/v_/collection1/
[junit4:junit4] 2> 185766 T764 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 185766 T764 oasc.SyncStrategy.syncToMe http://127.0.0.1:10730/v_/collection1/ has no replicas
[junit4:junit4] 2> 185767 T764 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:10730/v_/collection1/
[junit4:junit4] 2> 185767 T764 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 186884 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 186906 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 186951 T764 oasc.ZkController.register We are http://127.0.0.1:10730/v_/collection1/ and leader is http://127.0.0.1:10730/v_/collection1/
[junit4:junit4] 2> 186951 T764 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:10730/v_
[junit4:junit4] 2> 186951 T764 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 186952 T764 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 186952 T764 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 186955 T764 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 186956 T739 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 186957 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 186958 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 186970 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 186979 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 186981 T768 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11fc80a2 name:ZooKeeperConnection Watcher:127.0.0.1:62017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 186982 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 186984 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 186991 T739 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 187240 T739 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 187243 T739 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:62311
[junit4:junit4] 2> 187244 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 187244 T739 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 187245 T739 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369718908592
[junit4:junit4] 2> 187245 T739 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369718908592/solr.xml
[junit4:junit4] 2> 187246 T739 oasc.CoreContainer.<init> New CoreContainer 659008535
[junit4:junit4] 2> 187246 T739 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369718908592/'
[junit4:junit4] 2> 187247 T739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369718908592/'
[junit4:junit4] 2> 187365 T739 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 187366 T739 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 187367 T739 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 187367 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 187368 T739 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 187368 T739 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 187368 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 187369 T739 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 187369 T739 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 187370 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 187385 T739 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 187386 T739 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62017/solr
[junit4:junit4] 2> 187387 T739 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 187388 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 187427 T779 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@268b038a name:ZooKeeperConnection Watcher:127.0.0.1:62017 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 187428 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 187443 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 187454 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 187457 T781 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a4d4d71 name:ZooKeeperConnection Watcher:127.0.0.1:62017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 187457 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 187470 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 188421 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 188423 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:10730_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10730/v_"}
[junit4:junit4] 2> 188436 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 188436 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 188436 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 188476 T739 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62311_v_
[junit4:junit4] 2> 188478 T739 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62311_v_
[junit4:junit4] 2> 188481 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 188482 T768 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 188482 T781 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 188483 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 188483 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 188484 T761 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 188500 T782 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369718908592/collection1
[junit4:junit4] 2> 188501 T782 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 188502 T782 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 188503 T782 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 188505 T782 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369718908592/collection1/'
[junit4:junit4] 2> 188507 T782 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369718908592/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 188508 T782 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369718908592/collection1/lib/README' to classloader
[junit4:junit4] 2> 188567 T782 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 188635 T782 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 188737 T782 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 188749 T782 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 189353 T782 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 189357 T782 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 189359 T782 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 189366 T782 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 189424 T782 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 189425 T782 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369718908592/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty1/
[junit4:junit4] 2> 189425 T782 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@50ed8317
[junit4:junit4] 2> 189426 T782 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 189427 T782 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty1
[junit4:junit4] 2> 189427 T782 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty1/index/
[junit4:junit4] 2> 189427 T782 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 189428 T782 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty1/index
[junit4:junit4] 2> 189435 T782 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ff8aa24 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63fcc8ce),segFN=segments_1,generation=1}
[junit4:junit4] 2> 189436 T782 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 189450 T782 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 189451 T782 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 189452 T782 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 189453 T782 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 189453 T782 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 189454 T782 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 189454 T782 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 189455 T782 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 189456 T782 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 189473 T782 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 189481 T782 oass.SolrIndexSearcher.<init> Opening Searcher@68372c9f main
[junit4:junit4] 2> 189481 T782 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty1/tlog
[junit4:junit4] 2> 189483 T782 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 189483 T782 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 189489 T783 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@68372c9f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 189491 T782 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 189492 T782 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 189945 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 189946 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62311_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62311/v_"}
[junit4:junit4] 2> 189947 T762 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 189947 T762 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 189969 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 189969 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 189969 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 190495 T782 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 190495 T782 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62311/v_ collection:collection1 shard:shard1
[junit4:junit4] 2> 190497 T782 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 190521 T782 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 190532 T782 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 190533 T782 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 190533 T782 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62311/v_/collection1/
[junit4:junit4] 2> 190533 T782 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 190533 T782 oasc.SyncStrategy.syncToMe http://127.0.0.1:62311/v_/collection1/ has no replicas
[junit4:junit4] 2> 190534 T782 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62311/v_/collection1/
[junit4:junit4] 2> 190534 T782 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 191477 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 191512 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 191512 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 191512 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 191519 T782 oasc.ZkController.register We are http://127.0.0.1:62311/v_/collection1/ and leader is http://127.0.0.1:62311/v_/collection1/
[junit4:junit4] 2> 191519 T782 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62311/v_
[junit4:junit4] 2> 191519 T782 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 191519 T782 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 191520 T782 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 191522 T782 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 191524 T739 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 191525 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 191525 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 191830 T739 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 191833 T739 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:50204
[junit4:junit4] 2> 191834 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 191835 T739 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 191835 T739 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369718913144
[junit4:junit4] 2> 191836 T739 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369718913144/solr.xml
[junit4:junit4] 2> 191836 T739 oasc.CoreContainer.<init> New CoreContainer 290532760
[junit4:junit4] 2> 191837 T739 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369718913144/'
[junit4:junit4] 2> 191837 T739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369718913144/'
[junit4:junit4] 2> 191979 T739 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 191980 T739 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 191981 T739 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 191981 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 191982 T739 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 191982 T739 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 191983 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 191983 T739 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 191984 T739 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 191984 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 192002 T739 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 192003 T739 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62017/solr
[junit4:junit4] 2> 192004 T739 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 192005 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 192008 T795 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68b43662 name:ZooKeeperConnection Watcher:127.0.0.1:62017 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 192009 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 192012 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 192024 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 192027 T797 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16948622 name:ZooKeeperConnection Watcher:127.0.0.1:62017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 192028 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 192041 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 193028 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 193029 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:62311_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:62311/v_"}
[junit4:junit4] 2> 193045 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 193045 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 193045 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 193045 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 193047 T739 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50204_v_
[junit4:junit4] 2> 193050 T739 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50204_v_
[junit4:junit4] 2> 193058 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 193058 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 193059 T781 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 193059 T768 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 193059 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 193059 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 193061 T761 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 193062 T797 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 193070 T798 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369718913144/collection1
[junit4:junit4] 2> 193070 T798 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 193071 T798 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 193071 T798 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 193074 T798 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369718913144/collection1/'
[junit4:junit4] 2> 193075 T798 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369718913144/collection1/lib/README' to classloader
[junit4:junit4] 2> 193076 T798 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369718913144/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 193134 T798 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 193198 T798 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 193300 T798 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 193313 T798 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 193950 T798 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 193955 T798 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 193958 T798 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 193964 T798 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 194013 T798 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 194013 T798 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369718913144/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty2/
[junit4:junit4] 2> 194014 T798 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@50ed8317
[junit4:junit4] 2> 194014 T798 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 194015 T798 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty2
[junit4:junit4] 2> 194015 T798 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty2/index/
[junit4:junit4] 2> 194016 T798 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 194017 T798 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty2/index
[junit4:junit4] 2> 194021 T798 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@531f73a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d87608e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 194021 T798 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 194025 T798 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 194025 T798 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 194026 T798 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 194027 T798 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 194027 T798 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 194028 T798 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 194028 T798 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 194029 T798 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 194029 T798 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 194048 T798 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 194057 T798 oass.SolrIndexSearcher.<init> Opening Searcher@6698ee3c main
[junit4:junit4] 2> 194057 T798 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty2/tlog
[junit4:junit4] 2> 194058 T798 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 194059 T798 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 194063 T799 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6698ee3c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 194066 T798 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 194066 T798 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 194554 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 194555 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50204_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50204/v_"}
[junit4:junit4] 2> 194556 T762 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 194556 T762 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 194576 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 194576 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 194576 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 194576 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 195070 T798 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 195070 T798 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50204/v_ collection:collection1 shard:shard2
[junit4:junit4] 2> 195071 T798 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 195118 T798 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 195130 T798 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 195130 T798 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 195131 T798 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50204/v_/collection1/
[junit4:junit4] 2> 195131 T798 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 195131 T798 oasc.SyncStrategy.syncToMe http://127.0.0.1:50204/v_/collection1/ has no replicas
[junit4:junit4] 2> 195132 T798 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50204/v_/collection1/
[junit4:junit4] 2> 195132 T798 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 196092 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 196138 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 196139 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 196139 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 196138 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 196166 T798 oasc.ZkController.register We are http://127.0.0.1:50204/v_/collection1/ and leader is http://127.0.0.1:50204/v_/collection1/
[junit4:junit4] 2> 196166 T798 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50204/v_
[junit4:junit4] 2> 196166 T798 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 196166 T798 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 196167 T798 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 196169 T798 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 196171 T739 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 196172 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 196172 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 196465 T739 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 196468 T739 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32478
[junit4:junit4] 2> 196469 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 196470 T739 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 196470 T739 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369718917793
[junit4:junit4] 2> 196471 T739 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369718917793/solr.xml
[junit4:junit4] 2> 196471 T739 oasc.CoreContainer.<init> New CoreContainer 1670595239
[junit4:junit4] 2> 196472 T739 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369718917793/'
[junit4:junit4] 2> 196472 T739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369718917793/'
[junit4:junit4] 2> 196616 T739 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 196617 T739 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 196617 T739 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 196618 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 196619 T739 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 196619 T739 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 196620 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 196620 T739 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 196621 T739 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 196621 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 196640 T739 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 196641 T739 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62017/solr
[junit4:junit4] 2> 196641 T739 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 196642 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 196646 T811 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@245ef9fd name:ZooKeeperConnection Watcher:127.0.0.1:62017 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 196646 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 196665 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 196679 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 196681 T813 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63b0f9f0 name:ZooKeeperConnection Watcher:127.0.0.1:62017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 196682 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 196695 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 197654 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 197655 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50204_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50204/v_"}
[junit4:junit4] 2> 197672 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 197672 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 197672 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 197672 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 197672 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 197702 T739 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32478_v_
[junit4:junit4] 2> 197704 T739 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32478_v_
[junit4:junit4] 2> 197707 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 197708 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 197708 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 197708 T768 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 197709 T781 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 197709 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 197709 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 197711 T813 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 197711 T761 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 197711 T797 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 197719 T814 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369718917793/collection1
[junit4:junit4] 2> 197719 T814 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 197720 T814 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 197720 T814 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 197723 T814 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369718917793/collection1/'
[junit4:junit4] 2> 197724 T814 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369718917793/collection1/lib/README' to classloader
[junit4:junit4] 2> 197725 T814 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369718917793/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 197784 T814 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 197852 T814 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 197954 T814 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 197966 T814 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 198604 T814 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 198607 T814 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 198609 T814 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 198614 T814 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 198654 T814 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 198655 T814 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369718917793/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3/
[junit4:junit4] 2> 198655 T814 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@50ed8317
[junit4:junit4] 2> 198655 T814 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 198656 T814 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3
[junit4:junit4] 2> 198657 T814 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3/index/
[junit4:junit4] 2> 198657 T814 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 198657 T814 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3/index
[junit4:junit4] 2> 198660 T814 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29c3844b lockFactory=org.apache.lucene.store.NativeFSLockFactory@14c918b8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 198660 T814 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 198663 T814 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 198663 T814 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 198664 T814 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 198664 T814 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 198665 T814 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 198665 T814 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 198665 T814 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 198666 T814 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 198666 T814 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 198677 T814 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 198683 T814 oass.SolrIndexSearcher.<init> Opening Searcher@314570b4 main
[junit4:junit4] 2> 198683 T814 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3/tlog
[junit4:junit4] 2> 198684 T814 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 198685 T814 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 198688 T815 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@314570b4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 198690 T814 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 198690 T814 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 199180 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 199181 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:32478_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32478/v_"}
[junit4:junit4] 2> 199181 T762 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 199182 T762 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 199249 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 199249 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 199249 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 199249 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 199249 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 199694 T814 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 199694 T814 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:32478/v_ collection:collection1 shard:shard1
[junit4:junit4] 2> 199726 T814 oasc.ZkController.register We are http://127.0.0.1:32478/v_/collection1/ and leader is http://127.0.0.1:62311/v_/collection1/
[junit4:junit4] 2> 199726 T814 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32478/v_
[junit4:junit4] 2> 199726 T814 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 199727 T814 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C148 name=collection1 org.apache.solr.core.SolrCore@1c1936f9 url=http://127.0.0.1:32478/v_/collection1 node=127.0.0.1:32478_v_ C148_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:32478_v_, base_url=http://127.0.0.1:32478/v_}
[junit4:junit4] 2> 199735 T816 C148 P32478 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 199736 T814 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 199736 T816 C148 P32478 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 199737 T816 C148 P32478 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 199737 T816 C148 P32478 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 199738 T739 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 199738 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 199739 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 199739 T816 C148 P32478 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 199770 T771 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 200027 T739 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 200030 T739 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:53560
[junit4:junit4] 2> 200031 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 200031 T739 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 200032 T739 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369718921361
[junit4:junit4] 2> 200032 T739 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369718921361/solr.xml
[junit4:junit4] 2> 200033 T739 oasc.CoreContainer.<init> New CoreContainer 272681916
[junit4:junit4] 2> 200033 T739 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369718921361/'
[junit4:junit4] 2> 200034 T739 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369718921361/'
[junit4:junit4] 2> 200162 T739 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 200163 T739 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 200163 T739 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 200164 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 200164 T739 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 200165 T739 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 200165 T739 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 200166 T739 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 200166 T739 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 200167 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 200184 T739 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 200184 T739 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62017/solr
[junit4:junit4] 2> 200185 T739 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 200186 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 200208 T828 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ca269e2 name:ZooKeeperConnection Watcher:127.0.0.1:62017 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 200209 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 200211 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 200223 T739 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 200225 T830 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bbda190 name:ZooKeeperConnection Watcher:127.0.0.1:62017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 200226 T739 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 200238 T739 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 200772 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 200773 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:32478_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32478/v_"}
[junit4:junit4] 2> 200793 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 200794 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 200793 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 200793 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 200794 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 200793 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 201244 T739 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53560_v_
[junit4:junit4] 2> 201246 T739 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53560_v_
[junit4:junit4] 2> 201249 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 201250 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 201250 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 201250 T768 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 201250 T781 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 201250 T830 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 201251 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 201251 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 201251 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 201252 T761 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 201253 T797 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 201254 T813 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 201260 T831 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369718921361/collection1
[junit4:junit4] 2> 201261 T831 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 201262 T831 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 201262 T831 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 201264 T831 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369718921361/collection1/'
[junit4:junit4] 2> 201265 T831 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369718921361/collection1/lib/README' to classloader
[junit4:junit4] 2> 201266 T831 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369718921361/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 201324 T831 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 201386 T831 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 201488 T831 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 201499 T831 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 201773 T771 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 201773 T771 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:32478_v_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 202101 T831 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 202104 T831 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 202106 T831 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 202110 T831 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 202146 T831 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 202147 T831 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369718921361/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/
[junit4:junit4] 2> 202147 T831 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@50ed8317
[junit4:junit4] 2> 202148 T831 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 202148 T831 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4
[junit4:junit4] 2> 202148 T831 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index/
[junit4:junit4] 2> 202149 T831 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 202150 T831 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index
[junit4:junit4] 2> 202152 T831 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d71d851 lockFactory=org.apache.lucene.store.NativeFSLockFactory@afd6b6c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 202153 T831 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 202155 T831 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 202155 T831 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 202156 T831 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 202157 T831 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 202157 T831 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 202158 T831 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 202158 T831 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 202158 T831 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 202159 T831 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 202170 T831 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 202176 T831 oass.SolrIndexSearcher.<init> Opening Searcher@6daab103 main
[junit4:junit4] 2> 202176 T831 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/tlog
[junit4:junit4] 2> 202177 T831 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 202178 T831 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 202181 T832 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6daab103 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 202183 T831 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 202184 T831 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 202300 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 202302 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53560_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53560/v_"}
[junit4:junit4] 2> 202302 T762 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 202302 T762 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 202323 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 202323 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 202323 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 202323 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 202323 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 202323 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 203188 T831 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 203188 T831 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53560/v_ collection:collection1 shard:shard2
[junit4:junit4] 2> 203193 T831 oasc.ZkController.register We are http://127.0.0.1:53560/v_/collection1/ and leader is http://127.0.0.1:50204/v_/collection1/
[junit4:junit4] 2> 203194 T831 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53560/v_
[junit4:junit4] 2> 203194 T831 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 203194 T831 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C149 name=collection1 org.apache.solr.core.SolrCore@77c9eaa8 url=http://127.0.0.1:53560/v_/collection1 node=127.0.0.1:53560_v_ C149_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53560_v_, base_url=http://127.0.0.1:53560/v_}
[junit4:junit4] 2> 203195 T833 C149 P53560 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 203196 T833 C149 P53560 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 203196 T831 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 203196 T833 C149 P53560 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 203197 T833 C149 P53560 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 203198 T739 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 203199 T833 C149 P53560 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 203199 T739 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 203200 T739 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 203225 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 203225 T787 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 203227 T739 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 203227 T739 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 203229 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C150 name=collection1 org.apache.solr.core.SolrCore@1c1936f9 url=http://127.0.0.1:32478/v_/collection1 node=127.0.0.1:32478_v_ C150_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:32478_v_, base_url=http://127.0.0.1:32478/v_}
[junit4:junit4] 2> 203776 T816 C150 P32478 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:62311/v_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 203791 T816 C150 P32478 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 203813 T816 C150 P32478 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:32478/v_ START replicas=[http://127.0.0.1:62311/v_/collection1/] nUpdates=100
[junit4:junit4] 2> 203814 T816 C150 P32478 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 203815 T816 C150 P32478 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 203815 T816 C150 P32478 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 203815 T816 C150 P32478 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 203816 T816 C150 P32478 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 203816 T816 C150 P32478 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:62311/v_/collection1/. core=collection1
[junit4:junit4] 2> 203816 T816 C150 P32478 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C151 name=collection1 org.apache.solr.core.SolrCore@62df6d9a url=http://127.0.0.1:62311/v_/collection1 node=127.0.0.1:62311_v_ C151_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:62311_v_, base_url=http://127.0.0.1:62311/v_, leader=true}
[junit4:junit4] 2> 203825 T772 C151 P62311 oasc.SolrCore.execute [collection1] webapp=/v_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 203831 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 203832 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53560_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53560/v_"}
[junit4:junit4] 2> 203835 T773 C151 P62311 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 203838 T773 C151 P62311 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ff8aa24 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63fcc8ce),segFN=segments_1,generation=1}
[junit4:junit4] 2> 203839 T773 C151 P62311 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 203839 T773 C151 P62311 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ff8aa24 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63fcc8ce),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ff8aa24 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63fcc8ce),segFN=segments_2,generation=2}
[junit4:junit4] 2> 203840 T773 C151 P62311 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 203840 T773 C151 P62311 oass.SolrIndexSearcher.<init> Opening Searcher@674e0581 realtime
[junit4:junit4] 2> 203841 T773 C151 P62311 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 203841 T773 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 12
[junit4:junit4] 2> 203842 T816 C150 P32478 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 203843 T816 C150 P32478 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 203845 T774 C151 P62311 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 203845 T774 C151 P62311 oasc.SolrCore.execute [collection1] webapp=/v_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 203846 T816 C150 P32478 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 203846 T816 C150 P32478 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 203847 T816 C150 P32478 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 203848 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 203849 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 203849 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 203849 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 203848 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 203848 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 203849 T774 C151 P62311 oasc.SolrCore.execute [collection1] webapp=/v_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 203851 T816 C150 P32478 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 203852 T816 C150 P32478 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3/index.20130528115845453
[junit4:junit4] 2> 203853 T816 C150 P32478 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@7b4bf743 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b948258) fullCopy=false
[junit4:junit4] 2> 203855 T774 C151 P62311 oasc.SolrCore.execute [collection1] webapp=/v_ path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 203856 T816 C150 P32478 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 203857 T816 C150 P32478 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 203858 T816 C150 P32478 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 203860 T816 C150 P32478 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29c3844b lockFactory=org.apache.lucene.store.NativeFSLockFactory@14c918b8),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29c3844b lockFactory=org.apache.lucene.store.NativeFSLockFactory@14c918b8),segFN=segments_2,generation=2}
[junit4:junit4] 2> 203861 T816 C150 P32478 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 203861 T816 C150 P32478 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 203861 T816 C150 P32478 oass.SolrIndexSearcher.<init> Opening Searcher@245944e6 main
[junit4:junit4] 2> 203863 T815 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@245944e6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 203863 T816 C150 P32478 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3/index.20130528115845453 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3/index.20130528115845453;done=true>>]
[junit4:junit4] 2> 203864 T816 C150 P32478 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3/index.20130528115845453
[junit4:junit4] 2> 203864 T816 C150 P32478 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty3/index.20130528115845453
[junit4:junit4] 2> 203864 T816 C150 P32478 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 203864 T816 C150 P32478 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 203865 T816 C150 P32478 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 203865 T816 C150 P32478 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 203867 T816 C150 P32478 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 204227 T787 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 204227 T787 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:53560_v_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 204232 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 205235 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 205357 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 205358 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:32478_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32478/v_"}
[junit4:junit4] 2> 205371 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 205371 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 205371 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 205371 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 205371 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 205371 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> C149_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53560_v_, base_url=http://127.0.0.1:53560/v_}
[junit4:junit4] 2> 206229 T833 C149 P53560 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50204/v_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 206229 T833 C149 P53560 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53560/v_ START replicas=[http://127.0.0.1:50204/v_/collection1/] nUpdates=100
[junit4:junit4] 2> 206230 T833 C149 P53560 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 206230 T833 C149 P53560 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 206230 T833 C149 P53560 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 206230 T833 C149 P53560 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 206231 T833 C149 P53560 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 206231 T833 C149 P53560 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50204/v_/collection1/. core=collection1
[junit4:junit4] 2> 206231 T833 C149 P53560 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 206238 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C152 name=collection1 org.apache.solr.core.SolrCore@5316e77f url=http://127.0.0.1:50204/v_/collection1 node=127.0.0.1:50204_v_ C152_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50204_v_, base_url=http://127.0.0.1:50204/v_, leader=true}
[junit4:junit4] 2> 206240 T788 C152 P50204 oasc.SolrCore.execute [collection1] webapp=/v_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 206242 T789 C152 P50204 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 206244 T789 C152 P50204 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@531f73a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d87608e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 206245 T789 C152 P50204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 206246 T789 C152 P50204 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@531f73a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d87608e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@531f73a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d87608e),segFN=segments_2,generation=2}
[junit4:junit4] 2> 206246 T789 C152 P50204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 206247 T789 C152 P50204 oass.SolrIndexSearcher.<init> Opening Searcher@2f8930c3 realtime
[junit4:junit4] 2> 206247 T789 C152 P50204 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 206247 T789 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 206248 T833 C149 P53560 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 206249 T833 C149 P53560 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 206250 T790 C152 P50204 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 206251 T790 C152 P50204 oasc.SolrCore.execute [collection1] webapp=/v_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 206251 T833 C149 P53560 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 206252 T833 C149 P53560 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 206252 T833 C149 P53560 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 206254 T790 C152 P50204 oasc.SolrCore.execute [collection1] webapp=/v_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 206255 T833 C149 P53560 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 206256 T833 C149 P53560 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index.20130528115847856
[junit4:junit4] 2> 206256 T833 C149 P53560 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3cd8cd39 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f612b5b) fullCopy=false
[junit4:junit4] 2> 206259 T790 C152 P50204 oasc.SolrCore.execute [collection1] webapp=/v_ path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 206260 T833 C149 P53560 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 206261 T833 C149 P53560 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 206261 T833 C149 P53560 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 206263 T833 C149 P53560 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d71d851 lockFactory=org.apache.lucene.store.NativeFSLockFactory@afd6b6c),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d71d851 lockFactory=org.apache.lucene.store.NativeFSLockFactory@afd6b6c),segFN=segments_2,generation=2}
[junit4:junit4] 2> 206264 T833 C149 P53560 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 206264 T833 C149 P53560 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 206264 T833 C149 P53560 oass.SolrIndexSearcher.<init> Opening Searcher@4eaa7d7e main
[junit4:junit4] 2> 206266 T832 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4eaa7d7e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 206266 T833 C149 P53560 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index.20130528115847856 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index.20130528115847856;done=true>>]
[junit4:junit4] 2> 206267 T833 C149 P53560 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index.20130528115847856
[junit4:junit4] 2> 206267 T833 C149 P53560 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index.20130528115847856
[junit4:junit4] 2> 206267 T833 C149 P53560 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 206267 T833 C149 P53560 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 206268 T833 C149 P53560 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 206268 T833 C149 P53560 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 206280 T833 C149 P53560 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 206879 T762 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 206880 T762 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53560_v_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53560/v_"}
[junit4:junit4] 2> 206894 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 206894 T781 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 206894 T797 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 206894 T813 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 206894 T768 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 206894 T761 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 207241 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 207242 T739 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C153 name=collection1 org.apache.solr.core.SolrCore@180ebd24 url=http://127.0.0.1:10730/v_/collection1 node=127.0.0.1:10730_v_ C153_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:10730_v_, base_url=http://127.0.0.1:10730/v_, leader=true}
[junit4:junit4] 2> 207249 T751 C153 P10730 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 207252 T751 C153 P10730 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42f4aaa lockFactory=org.apache.lucene.store.NativeFSLockFactory@74effb5c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 207252 T751 C153 P10730 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 207253 T751 C153 P10730 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42f4aaa lockFactory=org.apache.lucene.store.NativeFSLockFactory@74effb5c),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42f4aaa lockFactory=org.apache.lucene.store.NativeFSLockFactory@74effb5c),segFN=segments_2,generation=2}
[junit4:junit4] 2> 207253 T751 C153 P10730 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 207254 T751 C153 P10730 oass.SolrIndexSearcher.<init> Opening Searcher@37bdce24 main
[junit4:junit4] 2> 207254 T751 C153 P10730 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 207255 T765 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@37bdce24 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 207256 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 207282 T775 C151 P62311 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 207284 T775 C151 P62311 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ff8aa24 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63fcc8ce),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1ff8aa24 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63fcc8ce),segFN=segments_3,generation=3}
[junit4:junit4] 2> 207284 T775 C151 P62311 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 207285 T775 C151 P62311 oass.SolrIndexSearcher.<init> Opening Searcher@3cb9da64 main
[junit4:junit4] 2> 207285 T775 C151 P62311 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 207286 T783 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3cb9da64 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 207304 T775 C151 P62311 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:32478/v_/collection1/, StdNode: http://127.0.0.1:50204/v_/collection1/, StdNode: http://127.0.0.1:53560/v_/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 207312 T791 C152 P50204 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 207314 T791 C152 P50204 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@531f73a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d87608e),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@531f73a0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d87608e),segFN=segments_3,generation=3}
[junit4:junit4] 2> 207314 T791 C152 P50204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 207315 T791 C152 P50204 oass.SolrIndexSearcher.<init> Opening Searcher@293a6c6f main
[junit4:junit4] 2> 207315 T791 C152 P50204 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 207316 T799 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@293a6c6f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 207317 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C150_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:32478_v_, base_url=http://127.0.0.1:32478/v_}
[junit4:junit4] 2> 207319 T803 C150 P32478 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 207320 T803 C150 P32478 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29c3844b lockFactory=org.apache.lucene.store.NativeFSLockFactory@14c918b8),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@29c3844b lockFactory=org.apache.lucene.store.NativeFSLockFactory@14c918b8),segFN=segments_3,generation=3}
[junit4:junit4] 2> 207320 T803 C150 P32478 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> C149_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53560_v_, base_url=http://127.0.0.1:53560/v_}
[junit4:junit4] 2> 207320 T820 C149 P53560 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 207320 T803 C150 P32478 oass.SolrIndexSearcher.<init> Opening Searcher@4b6bee9b main
[junit4:junit4] 2> 207321 T820 C149 P53560 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d71d851 lockFactory=org.apache.lucene.store.NativeFSLockFactory@afd6b6c),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d71d851 lockFactory=org.apache.lucene.store.NativeFSLockFactory@afd6b6c),segFN=segments_3,generation=3}
[junit4:junit4] 2> 207321 T803 C150 P32478 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 207322 T820 C149 P53560 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 207322 T815 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4b6bee9b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 207323 T820 C149 P53560 oass.SolrIndexSearcher.<init> Opening Searcher@70c89bb5 main
[junit4:junit4] 2> 207323 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 207323 T820 C149 P53560 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 207324 T832 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@70c89bb5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 207325 T820 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 207325 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 43
[junit4:junit4] 2> 207327 T739 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 207330 T776 C151 P62311 oasc.SolrCore.execute [collection1] webapp=/v_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 207332 T804 C150 P32478 oasc.SolrCore.execute [collection1] webapp=/v_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 207334 T792 C152 P50204 oasc.SolrCore.execute [collection1] webapp=/v_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 207336 T821 C149 P53560 oasc.SolrCore.execute [collection1] webapp=/v_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 209360 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436254397737730048)} 0 20
[junit4:junit4] 2> 209377 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={update.distrib=FROMLEADER&_version_=-1436254397754507264&update.from=http://127.0.0.1:50204/v_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436254397754507264)} 0 3
[junit4:junit4] 2> 209381 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={update.distrib=FROMLEADER&_version_=-1436254397767090176&update.from=http://127.0.0.1:62311/v_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436254397767090176)} 0 2
[junit4:junit4] 2> 209381 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1436254397767090176)} 0 7
[junit4:junit4] 2> 209382 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436254397754507264)} 0 19
[junit4:junit4] 2> 209387 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[0 (1436254397777575936)]} 0 2
[junit4:junit4] 2> 209421 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1436254397811130368)]} 0 1
[junit4:junit4] 2> 209422 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1436254397811130368)]} 0 5
[junit4:junit4] 2> 209422 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[0]} 0 32
[junit4:junit4] 2> 209425 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[1 (1436254397819518976)]} 0 0
[junit4:junit4] 2> 209432 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1436254397822664704)]} 0 1
[junit4:junit4] 2> 209432 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[1 (1436254397822664704)]} 0 4
[junit4:junit4] 2> 209436 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[2 (1436254397830004736)]} 0 1
[junit4:junit4] 2> 209446 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1436254397837344768)]} 0 1
[junit4:junit4] 2> 209447 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1436254397837344768)]} 0 5
[junit4:junit4] 2> 209448 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[2]} 0 9
[junit4:junit4] 2> 209451 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[3 (1436254397846781952)]} 0 0
[junit4:junit4] 2> 209459 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1436254397852024832)]} 0 0
[junit4:junit4] 2> 209460 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1436254397852024832)]} 0 4
[junit4:junit4] 2> 209461 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[3]} 0 7
[junit4:junit4] 2> 209464 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[4 (1436254397860413440)]} 0 0
[junit4:junit4] 2> 209470 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1436254397863559168)]} 0 0
[junit4:junit4] 2> 209471 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[4 (1436254397863559168)]} 0 4
[junit4:junit4] 2> 209474 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[5 (1436254397870899200)]} 0 0
[junit4:junit4] 2> 209483 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1436254397876142080)]} 0 1
[junit4:junit4] 2> 209483 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1436254397876142080)]} 0 4
[junit4:junit4] 2> 209484 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[5]} 0 7
[junit4:junit4] 2> 209487 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[6 (1436254397884530688)]} 0 0
[junit4:junit4] 2> 209493 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1436254397887676416)]} 0 0
[junit4:junit4] 2> 209494 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[6 (1436254397887676416)]} 0 4
[junit4:junit4] 2> 209498 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[7 (1436254397895016448)]} 0 1
[junit4:junit4] 2> 209507 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1436254397901307904)]} 0 1
[junit4:junit4] 2> 209507 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1436254397901307904)]} 0 4
[junit4:junit4] 2> 209508 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[7]} 0 8
[junit4:junit4] 2> 209511 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[8 (1436254397909696512)]} 0 0
[junit4:junit4] 2> 209518 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1436254397912842240)]} 0 1
[junit4:junit4] 2> 209518 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[8 (1436254397912842240)]} 0 4
[junit4:junit4] 2> 209521 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[9 (1436254397920182272)]} 0 0
[junit4:junit4] 2> 209527 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1436254397923328000)]} 0 0
[junit4:junit4] 2> 209528 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[9 (1436254397923328000)]} 0 4
[junit4:junit4] 2> 209531 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[10 (1436254397930668032)]} 0 0
[junit4:junit4] 2> 209537 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1436254397933813760)]} 0 0
[junit4:junit4] 2> 209538 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[10 (1436254397933813760)]} 0 4
[junit4:junit4] 2> 209541 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[11 (1436254397941153792)]} 0 0
[junit4:junit4] 2> 209548 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1436254397944299520)]} 0 1
[junit4:junit4] 2> 209548 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[11 (1436254397944299520)]} 0 4
[junit4:junit4] 2> 209552 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[12 (1436254397951639552)]} 0 1
[junit4:junit4] 2> 209558 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1436254397955833856)]} 0 0
[junit4:junit4] 2> 209559 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[12 (1436254397955833856)]} 0 4
[junit4:junit4] 2> 209563 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[13 (1436254397963173888)]} 0 1
[junit4:junit4] 2> 209568 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1436254397966319616)]} 0 0
[junit4:junit4] 2> 209569 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[13 (1436254397966319616)]} 0 4
[junit4:junit4] 2> 209573 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[14 (1436254397973659648)]} 0 1
[junit4:junit4] 2> 209582 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1436254397980999680)]} 0 0
[junit4:junit4] 2> 209583 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1436254397980999680)]} 0 4
[junit4:junit4] 2> 209584 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[14]} 0 8
[junit4:junit4] 2> 209588 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[15 (1436254397989388288)]} 0 1
[junit4:junit4] 2> 209598 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1436254397996728320)]} 0 1
[junit4:junit4] 2> 209598 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[15 (1436254397996728320)]} 0 4
[junit4:junit4] 2> 209599 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[15]} 0 8
[junit4:junit4] 2> 209602 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[16 (1436254398005116928)]} 0 0
[junit4:junit4] 2> 209609 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1436254398008262656)]} 0 1
[junit4:junit4] 2> 209609 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[16 (1436254398008262656)]} 0 4
[junit4:junit4] 2> 209612 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[17 (1436254398015602688)]} 0 0
[junit4:junit4] 2> 209621 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1436254398020845568)]} 0 1
[junit4:junit4] 2> 209623 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1436254398020845568)]} 0 6
[junit4:junit4] 2> 209624 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[17]} 0 9
[junit4:junit4] 2> 209628 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[18 (1436254398032379904)]} 0 1
[junit4:junit4] 2> 209635 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1436254398035525632)]} 0 1
[junit4:junit4] 2> 209635 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[18 (1436254398035525632)]} 0 4
[junit4:junit4] 2> 209638 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[19 (1436254398042865664)]} 0 0
[junit4:junit4] 2> 209647 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1436254398049157120)]} 0 0
[junit4:junit4] 2> 209648 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[19 (1436254398049157120)]} 0 4
[junit4:junit4] 2> 209649 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[19]} 0 8
[junit4:junit4] 2> 209653 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[20 (1436254398057545728)]} 0 0
[junit4:junit4] 2> 209661 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1436254398063837184)]} 0 0
[junit4:junit4] 2> 209662 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[20 (1436254398063837184)]} 0 4
[junit4:junit4] 2> 209663 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[20]} 0 8
[junit4:junit4] 2> 209667 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[21 (1436254398072225792)]} 0 1
[junit4:junit4] 2> 209672 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1436254398075371520)]} 0 0
[junit4:junit4] 2> 209673 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[21 (1436254398075371520)]} 0 4
[junit4:junit4] 2> 209676 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[22 (1436254398082711552)]} 0 0
[junit4:junit4] 2> 209683 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1436254398085857280)]} 0 1
[junit4:junit4] 2> 209683 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[22 (1436254398085857280)]} 0 4
[junit4:junit4] 2> 209686 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[23 (1436254398093197312)]} 0 0
[junit4:junit4] 2> 209692 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1436254398096343040)]} 0 0
[junit4:junit4] 2> 209693 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[23 (1436254398096343040)]} 0 4
[junit4:junit4] 2> 209696 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[24 (1436254398103683072)]} 0 0
[junit4:junit4] 2> 209702 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1436254398106828800)]} 0 0
[junit4:junit4] 2> 209703 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[24 (1436254398106828800)]} 0 4
[junit4:junit4] 2> 209707 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[25 (1436254398114168832)]} 0 1
[junit4:junit4] 2> 209713 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1436254398118363136)]} 0 0
[junit4:junit4] 2> 209714 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[25 (1436254398118363136)]} 0 4
[junit4:junit4] 2> 209717 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[26 (1436254398125703168)]} 0 0
[junit4:junit4] 2> 209723 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1436254398128848896)]} 0 0
[junit4:junit4] 2> 209724 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[26 (1436254398128848896)]} 0 4
[junit4:junit4] 2> 209727 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[27 (1436254398136188928)]} 0 0
[junit4:junit4] 2> 209735 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1436254398141431808)]} 0 0
[junit4:junit4] 2> 209736 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[27 (1436254398141431808)]} 0 4
[junit4:junit4] 2> 209737 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[27]} 0 7
[junit4:junit4] 2> 209741 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[28 (1436254398149820416)]} 0 1
[junit4:junit4] 2> 209747 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1436254398152966144)]} 0 1
[junit4:junit4] 2> 209748 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[28 (1436254398152966144)]} 0 5
[junit4:junit4] 2> 209750 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[29 (1436254398160306176)]} 0 0
[junit4:junit4] 2> 209756 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1436254398163451904)]} 0 0
[junit4:junit4] 2> 209757 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[29 (1436254398163451904)]} 0 4
[junit4:junit4] 2> 209760 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[30 (1436254398170791936)]} 0 0
[junit4:junit4] 2> 209767 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1436254398173937664)]} 0 1
[junit4:junit4] 2> 209767 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[30 (1436254398173937664)]} 0 4
[junit4:junit4] 2> 209771 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[31 (1436254398181277696)]} 0 1
[junit4:junit4] 2> 209778 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1436254398186520576)]} 0 0
[junit4:junit4] 2> 209779 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[31 (1436254398186520576)]} 0 4
[junit4:junit4] 2> 209780 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[31]} 0 7
[junit4:junit4] 2> 209784 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[32 (1436254398194909184)]} 0 1
[junit4:junit4] 2> 209790 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1436254398198054912)]} 0 1
[junit4:junit4] 2> 209790 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[32 (1436254398198054912)]} 0 4
[junit4:junit4] 2> 209793 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[33 (1436254398205394944)]} 0 0
[junit4:junit4] 2> 209802 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1436254398210637824)]} 0 1
[junit4:junit4] 2> 209802 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[33 (1436254398210637824)]} 0 4
[junit4:junit4] 2> 209803 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[33]} 0 7
[junit4:junit4] 2> 209807 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[34 (1436254398219026432)]} 0 1
[junit4:junit4] 2> 209816 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1436254398225317888)]} 0 1
[junit4:junit4] 2> 209816 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[34 (1436254398225317888)]} 0 4
[junit4:junit4] 2> 209817 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[34]} 0 8
[junit4:junit4] 2> 209820 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[35 (1436254398233706496)]} 0 0
[junit4:junit4] 2> 209827 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1436254398236852224)]} 0 1
[junit4:junit4] 2> 209827 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[35 (1436254398236852224)]} 0 4
[junit4:junit4] 2> 209830 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[36 (1436254398244192256)]} 0 0
[junit4:junit4] 2> 209837 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1436254398247337984)]} 0 1
[junit4:junit4] 2> 209837 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[36 (1436254398247337984)]} 0 4
[junit4:junit4] 2> 209840 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[37 (1436254398254678016)]} 0 0
[junit4:junit4] 2> 209846 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1436254398257823744)]} 0 0
[junit4:junit4] 2> 209847 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[37 (1436254398257823744)]} 0 4
[junit4:junit4] 2> 209851 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[38 (1436254398266212352)]} 0 1
[junit4:junit4] 2> 209862 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1436254398273552384)]} 0 1
[junit4:junit4] 2> 209863 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[38 (1436254398273552384)]} 0 5
[junit4:junit4] 2> 209864 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[38]} 0 9
[junit4:junit4] 2> 209867 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[39 (1436254398281940992)]} 0 1
[junit4:junit4] 2> 209875 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1436254398287183872)]} 0 0
[junit4:junit4] 2> 209875 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[39 (1436254398287183872)]} 0 4
[junit4:junit4] 2> 209876 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[39]} 0 7
[junit4:junit4] 2> 209879 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[40 (1436254398295572480)]} 0 0
[junit4:junit4] 2> 209888 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1436254398301863936)]} 0 0
[junit4:junit4] 2> 209889 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[40 (1436254398301863936)]} 0 4
[junit4:junit4] 2> 209890 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[40]} 0 8
[junit4:junit4] 2> 209893 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[41 (1436254398310252544)]} 0 0
[junit4:junit4] 2> 209899 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1436254398313398272)]} 0 0
[junit4:junit4] 2> 209900 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[41 (1436254398313398272)]} 0 4
[junit4:junit4] 2> 209904 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[42 (1436254398320738304)]} 0 1
[junit4:junit4] 2> 209910 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1436254398324932608)]} 0 0
[junit4:junit4] 2> 209911 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[42 (1436254398324932608)]} 0 4
[junit4:junit4] 2> 209914 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[43 (1436254398332272640)]} 0 0
[junit4:junit4] 2> 209921 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1436254398335418368)]} 0 1
[junit4:junit4] 2> 209921 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[43 (1436254398335418368)]} 0 4
[junit4:junit4] 2> 209924 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[44 (1436254398342758400)]} 0 0
[junit4:junit4] 2> 209930 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1436254398345904128)]} 0 0
[junit4:junit4] 2> 209931 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[44 (1436254398345904128)]} 0 4
[junit4:junit4] 2> 209934 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[45 (1436254398353244160)]} 0 0
[junit4:junit4] 2> 209943 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1436254398358487040)]} 0 1
[junit4:junit4] 2> 209943 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[45 (1436254398358487040)]} 0 4
[junit4:junit4] 2> 209944 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[45]} 0 7
[junit4:junit4] 2> 209948 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[46 (1436254398366875648)]} 0 1
[junit4:junit4] 2> 209954 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1436254398370021376)]} 0 1
[junit4:junit4] 2> 209954 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[46 (1436254398370021376)]} 0 4
[junit4:junit4] 2> 209957 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[47 (1436254398377361408)]} 0 0
[junit4:junit4] 2> 209966 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1436254398383652864)]} 0 0
[junit4:junit4] 2> 209967 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[47 (1436254398383652864)]} 0 4
[junit4:junit4] 2> 209968 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[47]} 0 8
[junit4:junit4] 2> 209971 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[48 (1436254398392041472)]} 0 0
[junit4:junit4] 2> 209977 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1436254398395187200)]} 0 0
[junit4:junit4] 2> 209978 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[48 (1436254398395187200)]} 0 4
[junit4:junit4] 2> 209982 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[49 (1436254398402527232)]} 0 1
[junit4:junit4] 2> 209990 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1436254398408818688)]} 0 0
[junit4:junit4] 2> 209991 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[49 (1436254398408818688)]} 0 4
[junit4:junit4] 2> 209992 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[49]} 0 7
[junit4:junit4] 2> 209995 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[50 (1436254398417207296)]} 0 0
[junit4:junit4] 2> 210004 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1436254398422450176)]} 0 1
[junit4:junit4] 2> 210005 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[50 (1436254398422450176)]} 0 5
[junit4:junit4] 2> 210007 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[50]} 0 9
[junit4:junit4] 2> 210010 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[51 (1436254398432935936)]} 0 0
[junit4:junit4] 2> 210019 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1436254398438178816)]} 0 1
[junit4:junit4] 2> 210019 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[51 (1436254398438178816)]} 0 4
[junit4:junit4] 2> 210020 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[51]} 0 7
[junit4:junit4] 2> 210024 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[52 (1436254398446567424)]} 0 1
[junit4:junit4] 2> 210029 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1436254398449713152)]} 0 0
[junit4:junit4] 2> 210030 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[52 (1436254398449713152)]} 0 4
[junit4:junit4] 2> 210033 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[53 (1436254398457053184)]} 0 0
[junit4:junit4] 2> 210040 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1436254398460198912)]} 0 1
[junit4:junit4] 2> 210040 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[53 (1436254398460198912)]} 0 4
[junit4:junit4] 2> 210043 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[54 (1436254398467538944)]} 0 0
[junit4:junit4] 2> 210049 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1436254398470684672)]} 0 0
[junit4:junit4] 2> 210050 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[54 (1436254398470684672)]} 0 4
[junit4:junit4] 2> 210053 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[55 (1436254398478024704)]} 0 0
[junit4:junit4] 2> 210059 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1436254398481170432)]} 0 0
[junit4:junit4] 2> 210060 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[55 (1436254398481170432)]} 0 4
[junit4:junit4] 2> 210063 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[56 (1436254398488510464)]} 0 0
[junit4:junit4] 2> 210073 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[56 (1436254398494801920)]} 0 1
[junit4:junit4] 2> 210073 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[56 (1436254398494801920)]} 0 4
[junit4:junit4] 2> 210074 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[56]} 0 8
[junit4:junit4] 2> 210078 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[57 (1436254398503190528)]} 0 1
[junit4:junit4] 2> 210083 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[57 (1436254398506336256)]} 0 0
[junit4:junit4] 2> 210084 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[57 (1436254398506336256)]} 0 4
[junit4:junit4] 2> 210087 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[58 (1436254398513676288)]} 0 0
[junit4:junit4] 2> 210096 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[58 (1436254398519967744)]} 0 0
[junit4:junit4] 2> 210097 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[58 (1436254398519967744)]} 0 4
[junit4:junit4] 2> 210098 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[58]} 0 8
[junit4:junit4] 2> 210102 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[59 (1436254398528356352)]} 0 1
[junit4:junit4] 2> 210111 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[59 (1436254398533599232)]} 0 1
[junit4:junit4] 2> 210112 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[59 (1436254398533599232)]} 0 6
[junit4:junit4] 2> 210112 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[59]} 0 8
[junit4:junit4] 2> 210116 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[60 (1436254398543036416)]} 0 1
[junit4:junit4] 2> 210124 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[60 (1436254398549327872)]} 0 0
[junit4:junit4] 2> 210125 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[60 (1436254398549327872)]} 0 4
[junit4:junit4] 2> 210126 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[60]} 0 8
[junit4:junit4] 2> 210129 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[61 (1436254398557716480)]} 0 0
[junit4:junit4] 2> 210137 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[61 (1436254398562959360)]} 0 0
[junit4:junit4] 2> 210138 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[61 (1436254398562959360)]} 0 4
[junit4:junit4] 2> 210139 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[61]} 0 7
[junit4:junit4] 2> 210142 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[62 (1436254398570299392)]} 0 1
[junit4:junit4] 2> 210151 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[62 (1436254398576590848)]} 0 1
[junit4:junit4] 2> 210151 T791 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[62 (1436254398576590848)]} 0 4
[junit4:junit4] 2> 210152 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[62]} 0 7
[junit4:junit4] 2> 210155 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[63 (1436254398584979456)]} 0 0
[junit4:junit4] 2> 210162 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[63 (1436254398588125184)]} 0 1
[junit4:junit4] 2> 210162 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[63 (1436254398588125184)]} 0 4
[junit4:junit4] 2> 210165 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[64 (1436254398595465216)]} 0 0
[junit4:junit4] 2> 210171 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[64 (1436254398598610944)]} 0 0
[junit4:junit4] 2> 210172 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[64 (1436254398598610944)]} 0 4
[junit4:junit4] 2> 210176 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[65 (1436254398605950976)]} 0 1
[junit4:junit4] 2> 210181 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[65 (1436254398609096704)]} 0 0
[junit4:junit4] 2> 210182 T775 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[65 (1436254398609096704)]} 0 4
[junit4:junit4] 2> 210186 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[66 (1436254398616436736)]} 0 1
[junit4:junit4] 2> 210195 T803 C150 P32478 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:62311/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[66 (1436254398622728192)]} 0 1
[junit4:junit4] 2> 210195 T777 C151 P62311 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[66 (1436254398622728192)]} 0 4
[junit4:junit4] 2> 210196 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[66]} 0 8
[junit4:junit4] 2> 210199 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[67 (1436254398631116800)]} 0 0
[junit4:junit4] 2> 210205 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[67 (1436254398634262528)]} 0 0
[junit4:junit4] 2> 210206 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[67 (1436254398634262528)]} 0 4
[junit4:junit4] 2> 210210 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[68 (1436254398641602560)]} 0 1
[junit4:junit4] 2> 210215 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[68 (1436254398644748288)]} 0 0
[junit4:junit4] 2> 210216 T793 C152 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[68 (1436254398644748288)]} 0 4
[junit4:junit4] 2> 210220 T751 C153 P10730 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={wt=javabin&version=2} {add=[69 (1436254398653136896)]} 0 0
[junit4:junit4] 2> 210226 T822 C149 P53560 oasup.LogUpdateProcessor.finish [collection1] webapp=/v_ path=/update params={distrib.from=http://127.0.0.1:50204/v_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[69 (1436254398656282624)]} 0 0
[junit4:junit4] 2> 210227 T793
[...truncated too long message...]
265s J0 | ChaosMonkeyShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:62311/v_ returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([F025ACC0313AC5E5:71C322D84665A5D9]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 446856 T739 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 471197 T830 oasu.PeerSync.handleResponse WARN PeerSync: core=collection1 url=http://127.0.0.1:53560/v_ couldn't connect to http://127.0.0.1:50204/v_/collection1/, counting as success
[junit4:junit4] 2> 471197 T830 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53560/v_ DONE. sync succeeded
[junit4:junit4] 2> 471197 T830 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 471200 T830 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4] 2> 471201 T830 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53560/v_/collection1/
[junit4:junit4] 2> 471201 T830 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@77c9eaa8
[junit4:junit4] 2> 471203 T830 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=787,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 471203 T830 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 471204 T830 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 471204 T830 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 471207 T830 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 471207 T830 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 471208 T830 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4;done=false>>]
[junit4:junit4] 2> 471208 T830 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4
[junit4:junit4] 2> 471208 T830 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index;done=false>>]
[junit4:junit4] 2> 471208 T830 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369718903798/jetty4/index
[junit4:junit4] 2> 471209 T830 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 471209 T830 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89765898096869388-5-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 471210 T830 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 471210 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 471210 T830 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 471211 T830 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 471211 T830 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 471211 T830 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=MockSep), _version_=PostingsFormat(name=Direct)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=es_NI, timezone=Indian/Cocos
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=3,free=328797616,total=470810624
[junit4:junit4] 2> NOTE: All tests run in this JVM: [AnalysisAfterCoreReloadTest, SolrInfoMBeanTest, TestFastWriter, TestSolrIndexConfig, TestReversedWildcardFilterFactory, TestStressRecovery, SliceStateTest, ChaosMonkeyNothingIsSafeTest, TestPHPSerializedResponseWriter, SimpleFacetsTest, TestFaceting, DateFieldTest, TestFastLRUCache, PrimUtilsTest, PolyFieldTest, TestReplicationHandler, TestSchemaResource, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 289.74s, 1 test, 1 error <<< FAILURES!
[...truncated 787 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:380: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:360: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 error, 13 ignored (7 assumptions)
Total time: 49 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure